2026-03-29 18:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 18:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 18:35:05 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-29 18:35:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-29 18:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 18:35:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 18:35:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 18:35:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 18:35:05 [scrapy.extensions.telnet] INFO: Telnet Password: 575bcaaf48edbf62
2026-03-29 18:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 18:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-29T18_35_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 18:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 18:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 18:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 18:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 18:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 18:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-29 18:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 18:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 18:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 18:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 18:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 18:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 18:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 18:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 18:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-29 18:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 18:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 18:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 18:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 18:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 18:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 18:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 18:35:18 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08126%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Scrape type for ZJ08126: 1
2026-03-29 18:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN44067%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Scrape type for VN44067: 1
2026-03-29 18:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:18 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR93746%27 HTTP/1.1" 200 None
2026-03-29 18:35:18 [auto1.de] INFO: Scrape type for BR93746: 2
2026-03-29 18:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31bac75b-c813-5eac-829c-03674c94f02c with identifier: BR93746
2026-03-29 18:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31bac75b-c813-5eac-829c-03674c94f02c with scrape type 2
2026-03-29 18:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31bac75b-c813-5eac-829c-03674c94f02c with scrape type 2
2026-03-29 18:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31bac75b-c813-5eac-829c-03674c94f02c, identifier: BR93746
2026-03-29 18:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31bac75b-c813-5eac-829c-03674c94f02c with identifier: BR93746
2026-03-29 18:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31bac75b-c813-5eac-829c-03674c94f02c with identifier: BR93746
2026-03-29 18:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31bac75b-c813-5eac-829c-03674c94f02c with identifier: BR93746 to the API
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:06:26Z',
'fuel_type': 'diesel',
'id': '31bac75b-c813-5eac-829c-03674c94f02c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR93746',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 104035,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-20',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2019}
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR93746%27 HTTP/1.1" 200 None
2026-03-29 18:35:19 [auto1.de] INFO: Saving data for BR93746: {'auction_closing_time': 1774883186.0, 'created_time': 1774467655.211492, 'last_price_update_time': 1774809319.650511}
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR93746') HTTP/1.1" 204 0
2026-03-29 18:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:19 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-29 18:35:19 [auto1.de] INFO: Scrape type for PC62397: 2
2026-03-29 18:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-29 18:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2dc4ca7-d578-5e38-9e27-d40533f5c795 with scrape type 2
2026-03-29 18:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2dc4ca7-d578-5e38-9e27-d40533f5c795 with scrape type 2
2026-03-29 18:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2dc4ca7-d578-5e38-9e27-d40533f5c795, identifier: PC62397
2026-03-29 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 18:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-29 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397 to the API
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:02:12Z',
'fuel_type': 'petrol',
'id': 'f2dc4ca7-d578-5e38-9e27-d40533f5c795',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC62397',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 119149,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-03',
'seller_name': None,
'title': 'Audi Q3 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-29 18:35:20 [auto1.de] INFO: Saving data for PC62397: {'auction_closing_time': 1774882932.0, 'created_time': 1774381067.864226, 'last_price_update_time': 1774809320.439743}
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC62397') HTTP/1.1" 204 0
2026-03-29 18:35:20 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-29 18:35:20 [auto1.de] INFO: Scrape type for JV60507: 2
2026-03-29 18:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8818e363-efe1-53fe-aa1f-55356c289b6d with identifier: JV60507
2026-03-29 18:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8818e363-efe1-53fe-aa1f-55356c289b6d with scrape type 2
2026-03-29 18:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8818e363-efe1-53fe-aa1f-55356c289b6d with scrape type 2
2026-03-29 18:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8818e363-efe1-53fe-aa1f-55356c289b6d, identifier: JV60507
2026-03-29 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8818e363-efe1-53fe-aa1f-55356c289b6d with identifier: JV60507
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 18:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8818e363-efe1-53fe-aa1f-55356c289b6d with identifier: JV60507
2026-03-29 18:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8818e363-efe1-53fe-aa1f-55356c289b6d with identifier: JV60507 to the API
2026-03-29 18:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:54Z',
'fuel_type': 'diesel',
'id': '8818e363-efe1-53fe-aa1f-55356c289b6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV60507',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 144397,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-05',
'seller_name': None,
'title': 'BMW X1 xDrive 18d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Saving data for JV60507: {'auction_closing_time': 1774883514.0, 'created_time': 1774639900.319362, 'last_price_update_time': 1774809321.204125}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV60507') HTTP/1.1" 204 0
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Scrape type for ZR63828: 2
2026-03-29 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd27665-7c13-5280-ab97-cd9786e6c761 with identifier: ZR63828
2026-03-29 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd27665-7c13-5280-ab97-cd9786e6c761 with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd27665-7c13-5280-ab97-cd9786e6c761 with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bd27665-7c13-5280-ab97-cd9786e6c761, identifier: ZR63828
2026-03-29 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bd27665-7c13-5280-ab97-cd9786e6c761 with identifier: ZR63828
2026-03-29 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bd27665-7c13-5280-ab97-cd9786e6c761 with identifier: ZR63828
2026-03-29 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bd27665-7c13-5280-ab97-cd9786e6c761 with identifier: ZR63828 to the API
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:48:07Z',
'fuel_type': 'petrol',
'id': '2bd27665-7c13-5280-ab97-cd9786e6c761',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR63828',
'listing': 'auction',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 44060,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-10',
'seller_name': None,
'title': 'Jeep Renegade 1.6 Sport FWD',
'transmission': 'manual',
'trim': 'Sport FWD',
'year': 2016}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Saving data for ZR63828: {'auction_closing_time': 1774885687.0, 'created_time': 1774639486.907613, 'last_price_update_time': 1774809321.644009}
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR63828') HTTP/1.1" 204 0
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-29 18:35:21 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-29 18:35:21 [auto1.de] INFO: Scrape type for GN45872: 2
2026-03-29 18:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-29 18:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e056ce-3716-5bdb-8648-4146a7792edd with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19e056ce-3716-5bdb-8648-4146a7792edd with scrape type 2
2026-03-29 18:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19e056ce-3716-5bdb-8648-4146a7792edd, identifier: GN45872
2026-03-29 18:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-29 18:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-29 18:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872 to the API
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:37Z',
'fuel_type': 'petrol',
'id': '19e056ce-3716-5bdb-8648-4146a7792edd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN45872',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 53136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-01',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Saving data for GN45872: {'auction_closing_time': 1774885117.0, 'created_time': 1774293983.015387, 'last_price_update_time': 1774809322.103048}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN45872') HTTP/1.1" 204 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for RV72396: 2
2026-03-29 18:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396
2026-03-29 18:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with scrape type 2
2026-03-29 18:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with scrape type 2
2026-03-29 18:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8, identifier: RV72396
2026-03-29 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 18:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396
2026-03-29 18:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396 to the API
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:12Z',
'fuel_type': 'diesel',
'id': '5016cdf8-4bd5-5c19-92de-7be462f5a7d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV72396',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 145300,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-27',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Saving data for RV72396: {'auction_closing_time': 1774885212.0, 'created_time': 1774550963.353392, 'last_price_update_time': 1774809322.677353}
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV72396') HTTP/1.1" 204 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for PY88253: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for GE15008: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for FH74417: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for RG72110: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for AB70277: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN07930%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for GN07930: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for PJ34146: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for SU78317: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for PY59919: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for BE10482: 0
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 18:35:22 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-29 18:35:22 [auto1.de] INFO: Scrape type for DY40129: 0
2026-03-29 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ08126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN44067/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:24 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-29 18:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ08126> (referer: https://www.auto1.com/v1/car-details-view/ZJ08126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN44067> (referer: https://www.auto1.com/v1/car-details-view/VN44067/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:24 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/ZJ08126/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 18:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR93746%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for BR93746: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for PC62397: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for JV60507: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for ZR63828: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for GN45872: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for RV72396: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for PY88253: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for GE15008: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for FH74417: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for RG72110: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for AB70277: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN07930%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for GN07930: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for PJ34146: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for SU78317: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for PY59919: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for BE10482: 0
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 18:35:24 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [auto1.de] INFO: Scrape type for DY40129: 0
2026-03-29 18:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bdd28ea-491b-51df-9a82-ac3010f26e13 with identifier: ZJ08126
2026-03-29 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bdd28ea-491b-51df-9a82-ac3010f26e13 with scrape type 1
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bdd28ea-491b-51df-9a82-ac3010f26e13
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_032e57d286dce311704d92993659c698.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_032e57d286dce311704d92993659c698.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_c27aaca5524918b7586b49138dd30fb9.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_c27aaca5524918b7586b49138dd30fb9.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_8663be2e7954bd2678fd640d846ec323.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_8663be2e7954bd2678fd640d846ec323.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_578c4fc36e9724f3b26401d6afc04719.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_578c4fc36e9724f3b26401d6afc04719.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_61246484573e4e2deda00ac498b77853.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_61246484573e4e2deda00ac498b77853.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_70654c9fb6516191995b6936747df42f.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_70654c9fb6516191995b6936747df42f.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_288b8bbe2f21c1e2340ac55080f9e10e.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_288b8bbe2f21c1e2340ac55080f9e10e.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_92b61849ec4a44fa89787b07831f3d89.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_92b61849ec4a44fa89787b07831f3d89.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_be3c2745710a487b47ffaf138d7ab879.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_be3c2745710a487b47ffaf138d7ab879.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F8d%252F228d0c1d3e64c56ad8acb79764b9435e%252Fpa%252FZJ08126_43f6b4a22575d833bdcfab414b5185ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_43f6b4a22575d833bdcfab414b5185ae.jpg already downloaded
2026-03-29 18:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bdd28ea-491b-51df-9a82-ac3010f26e13, identifier: ZJ08126
2026-03-29 18:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7 with identifier: VN44067
2026-03-29 18:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7 with scrape type 1
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_a757d26d37f44d309208f52be28f0c45.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_a757d26d37f44d309208f52be28f0c45.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_f45f8a1126428ba25acb7e767e702d81.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_f45f8a1126428ba25acb7e767e702d81.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_265ce0bd24f829c7dc6764bb6e1edd72.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_265ce0bd24f829c7dc6764bb6e1edd72.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_e0b48ceea982737f1ea076d3f331c69d.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_e0b48ceea982737f1ea076d3f331c69d.jpg already downloaded
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_20c00807e482b664554e85e676bac60c.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_20c00807e482b664554e85e676bac60c.jpg already downloaded
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_d6a34b3c2d9828b5b46cc0e3f41f4b42.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_d6a34b3c2d9828b5b46cc0e3f41f4b42.jpg already downloaded
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_50d136ce5fa82720e8f78aaf033aff43.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_50d136ce5fa82720e8f78aaf033aff43.jpg already downloaded
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_703ec7495a0de45378c11dd480e398dc.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_703ec7495a0de45378c11dd480e398dc.jpg already downloaded
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_fe27489f2ea31483dda30300d5b4d38d.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_fe27489f2ea31483dda30300d5b4d38d.jpg already downloaded
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F47%252F72475aeee6ce9104f2c854ddfdd84d0e%252Fpa%252FVN44067_3f1b9e98a29f1b824e3b0d421c548629.jpg%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_3f1b9e98a29f1b824e3b0d421c548629.jpg already downloaded
2026-03-29 18:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7, identifier: VN44067
2026-03-29 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bdd28ea-491b-51df-9a82-ac3010f26e13 with identifier: ZJ08126
2026-03-29 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bdd28ea-491b-51df-9a82-ac3010f26e13 with identifier: ZJ08126
2026-03-29 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bdd28ea-491b-51df-9a82-ac3010f26e13 with identifier: ZJ08126 to the API
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZJ08126>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:53Z',
'fuel_type': 'diesel',
'id': '7bdd28ea-491b-51df-9a82-ac3010f26e13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ08126',
'listing': 'auction',
'location': 'DE',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 130039,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 20,
'photo_urls': ['https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_032e57d286dce311704d92993659c698.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_c27aaca5524918b7586b49138dd30fb9.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_8663be2e7954bd2678fd640d846ec323.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_578c4fc36e9724f3b26401d6afc04719.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_61246484573e4e2deda00ac498b77853.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_70654c9fb6516191995b6936747df42f.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_288b8bbe2f21c1e2340ac55080f9e10e.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_92b61849ec4a44fa89787b07831f3d89.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_be3c2745710a487b47ffaf138d7ab879.jpg',
'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_43f6b4a22575d833bdcfab414b5185ae.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_032e57d286dce311704d92993659c698.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_c27aaca5524918b7586b49138dd30fb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_8663be2e7954bd2678fd640d846ec323.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_578c4fc36e9724f3b26401d6afc04719.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_61246484573e4e2deda00ac498b77853.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_70654c9fb6516191995b6936747df42f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_288b8bbe2f21c1e2340ac55080f9e10e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_92b61849ec4a44fa89787b07831f3d89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_be3c2745710a487b47ffaf138d7ab879.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bdd28ea-491b-51df-9a82-ac3010f26e13/7bdd28ea-491b-51df-9a82-ac3010f26e13_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img22/8d/228d0c1d3e64c56ad8acb79764b9435e/pa/ZJ08126_43f6b4a22575d833bdcfab414b5185ae.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08126%27 HTTP/1.1" 200 None
2026-03-29 18:35:25 [auto1.de] INFO: Saving data for ZJ08126: {'created_time': 1774809325.565, 'last_price_update_time': 1774809325.565012, 'auction_closing_time': 1774885853.0}
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ08126') HTTP/1.1" 204 0
2026-03-29 18:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7 with identifier: VN44067
2026-03-29 18:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7 with identifier: VN44067
2026-03-29 18:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7 with identifier: VN44067 to the API
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VN44067>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:00:31Z',
'fuel_type': 'diesel',
'id': '18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN44067',
'listing': 'auction',
'location': 'DE',
'make': 'Nissan',
'model': 'NV250',
'odometer': 89544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 24,
'photo_urls': ['https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_a757d26d37f44d309208f52be28f0c45.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_f45f8a1126428ba25acb7e767e702d81.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_265ce0bd24f829c7dc6764bb6e1edd72.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_e0b48ceea982737f1ea076d3f331c69d.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_20c00807e482b664554e85e676bac60c.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_d6a34b3c2d9828b5b46cc0e3f41f4b42.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_50d136ce5fa82720e8f78aaf033aff43.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_703ec7495a0de45378c11dd480e398dc.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_fe27489f2ea31483dda30300d5b4d38d.jpg',
'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_3f1b9e98a29f1b824e3b0d421c548629.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_a757d26d37f44d309208f52be28f0c45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_f45f8a1126428ba25acb7e767e702d81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_265ce0bd24f829c7dc6764bb6e1edd72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_e0b48ceea982737f1ea076d3f331c69d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_20c00807e482b664554e85e676bac60c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_d6a34b3c2d9828b5b46cc0e3f41f4b42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2978123,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_50d136ce5fa82720e8f78aaf033aff43.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_703ec7495a0de45378c11dd480e398dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_fe27489f2ea31483dda30300d5b4d38d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7/18be619e-c46c-5df3-bcf2-8e7ad1ef6ad7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/47/72475aeee6ce9104f2c854ddfdd84d0e/pa/VN44067_3f1b9e98a29f1b824e3b0d421c548629.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-11',
'seats_number': 2,
'seller_name': None,
'title': 'Nissan NV250 1.5 dCi L2H1 2,2t Comfort',
'transmission': 'manual',
'trim': 'L2H1 2,2t Comfort',
'year': 2021}
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN44067%27 HTTP/1.1" 200 None
2026-03-29 18:35:26 [auto1.de] INFO: Saving data for VN44067: {'created_time': 1774809326.032781, 'last_price_update_time': 1774809326.032792, 'auction_closing_time': 1774882831.0}
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN44067') HTTP/1.1" 204 0
2026-03-29 18:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:27 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for BV77129: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for YH32466: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for ZW96632: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for NW88180: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for ZY10708: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for HC26014: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for BB56040: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for KY70270: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for JS58048: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for RC36772: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for KF39369: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for CX65130: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for FY70837: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for YL11317: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for ZH40630: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR52693%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for RR52693: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for NK75444: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA06623%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for AA06623: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63295%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for VY63295: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV42803%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for KV42803: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for NH05952: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90300%27 HTTP/1.1" 200 None
2026-03-29 18:35:27 [auto1.de] INFO: Scrape type for MM90300: 0
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-29 18:35:27 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-29 18:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:28 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE65557%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for LE65557: 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for LJ58074: 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for YY18465: 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for HJ76482: 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP69989%27 HTTP/1.1" 200 None
2026-03-29 18:35:28 [auto1.de] INFO: Scrape type for KP69989: 0
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-29 18:35:28 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-29 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for ZS29776: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ98033%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for PJ98033: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for ZA83090: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX62884%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for NX62884: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for JJ76956: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for ZX12399: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM20688%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for GM20688: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for HA10005: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ25681%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for CZ25681: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for GX28379: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH31359%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for UH31359: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG46226%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for LG46226: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE23086%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for BE23086: 0
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-29 18:35:29 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33586%27 HTTP/1.1" 200 None
2026-03-29 18:35:29 [auto1.de] INFO: Scrape type for GN33586: 0
2026-03-29 18:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:30 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for HN88809: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for NV36056: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF37615%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for GF37615: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for EK20296: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98570%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for MC98570: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY14465%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for JY14465: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT55225%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for TT55225: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for EX17549: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08681%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for TE08681: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB21625%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for HB21625: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE07121%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for VE07121: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83760%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for RL83760: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for UY63030: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17921%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for HH17921: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37823%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for MZ37823: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC19407%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for NC19407: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV56284%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for XV56284: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH07650%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for KH07650: 0
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-29 18:35:30 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS63746%27 HTTP/1.1" 200 None
2026-03-29 18:35:30 [auto1.de] INFO: Scrape type for BS63746: 0
2026-03-29 18:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:37 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for MR97164: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD67330%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for BD67330: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC71292%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for JC71292: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY86775%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for XY86775: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF90377%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for GF90377: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for EX05236: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70760%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for RR70760: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for FY44506: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for DC02620: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for LF08399: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT41300%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for MT41300: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT31487%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for WT31487: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB92022%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for HB92022: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54138%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for GT54138: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: US93398
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA07513%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for GA07513: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS02635%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for BS02635: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77068%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for TB77068: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB74163%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for UB74163: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB51359%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for NB51359: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for SP94156: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ70545%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for KJ70545: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV52830%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for NV52830: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for WM05984: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY76082%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for TY76082: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN17699%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for VN17699: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for EC36111: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67809%27 HTTP/1.1" 200 None
2026-03-29 18:35:37 [auto1.de] INFO: Scrape type for WJ67809: 0
2026-03-29 18:35:37 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-29 18:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:38 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK20630%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for JK20630: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE06039%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for WE06039: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR84816%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for UR84816: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF70247%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for UF70247: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ67042%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for ZJ67042: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA40486%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for JA40486: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for JL52757: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND21540%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for ND21540: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG25622%27 HTTP/1.1" 200 None
2026-03-29 18:35:38 [auto1.de] INFO: Scrape type for XG25622: 0
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-29 18:35:38 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-29 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX95412%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for VX95412: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for NP40069: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for AE04688: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW68690%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for VW68690: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for NX61710: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG72403%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for LG72403: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX92622%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for KX92622: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY89472%27 HTTP/1.1" 200 None
2026-03-29 18:35:39 [auto1.de] INFO: Scrape type for KY89472: 0
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-29 18:35:39 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-29 18:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:40 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13979%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for NV13979: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10535%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for SR10535: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM86164%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for CM86164: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for AD16750: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79090%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for JE79090: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU64777%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for TU64777: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for RK76188: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY93824%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for XY93824: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70330%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for YB70330: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for CJ04557: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for UD27058: 0
2026-03-29 18:35:40 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-29 18:35:40 [auto1.de] INFO: Scrape type for VV98645: 2
2026-03-29 18:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-29 18:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4722b5-fc94-57d1-b572-f0cc66851d4c with scrape type 2
2026-03-29 18:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4722b5-fc94-57d1-b572-f0cc66851d4c with scrape type 2
2026-03-29 18:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4722b5-fc94-57d1-b572-f0cc66851d4c, identifier: VV98645
2026-03-29 18:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-29 18:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-29 18:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645 to the API
2026-03-29 18:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:37:51Z',
'fuel_type': 'diesel',
'id': 'eb4722b5-fc94-57d1-b572-f0cc66851d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV98645',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 153771,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-19',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium X',
'transmission': 'automatic',
'trim': 'Titanium X',
'year': 2014}
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Saving data for VV98645: {'auction_closing_time': 1774885071.0, 'created_time': 1774292360.758484, 'last_price_update_time': 1774809341.201297}
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV98645') HTTP/1.1" 204 0
2026-03-29 18:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98673%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for MH98673: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for LD99689: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM98796%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for JM98796: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49409%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for TB49409: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB42822%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for NB42822: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU03533%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for KU03533: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for PM35820: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for RE71424: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ64186%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for TZ64186: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE78253%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for HE78253: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for WC37981: 0
2026-03-29 18:35:41 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA87343%27 HTTP/1.1" 200 None
2026-03-29 18:35:41 [auto1.de] INFO: Scrape type for HA87343: 0
2026-03-29 18:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:42 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91193%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for VU91193: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE57065%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for EE57065: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for BP97760: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04393%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for HC04393: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV78302%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for ZV78302: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20413%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for ES20413: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for LZ63004: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT21239%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for VT21239: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME62571%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for ME62571: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV69214%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for NV69214: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ23150%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for UJ23150: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK45245%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for YK45245: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for HS17931: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC50514%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for JC50514: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for TS98691: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for KH18492: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC78124%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for TC78124: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for PY29315: 0
2026-03-29 18:35:42 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW76911%27 HTTP/1.1" 200 None
2026-03-29 18:35:42 [auto1.de] INFO: Scrape type for WW76911: 0
2026-03-29 18:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:43 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for EE66446: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for VY63466: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for MB34428: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for PA05830: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17880%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for WL17880: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY52199%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for NY52199: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for CL67465: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for AX54291: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN25796%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for KN25796: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for NN77195: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF53472%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for NF53472: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30683%27 HTTP/1.1" 200 None
2026-03-29 18:35:43 [auto1.de] INFO: Scrape type for WX30683: 0
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-29 18:35:43 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for HZ13557: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP72119%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for CP72119: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for TU13190: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC49831%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for XC49831: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG80760%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for JG80760: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for TV16338: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for AS89586: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59540%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for ZB59540: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ65040%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for EZ65040: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR07785%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for KR07785: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-29 18:35:44 [auto1.de] INFO: Scrape type for CW58984: 0
2026-03-29 18:35:44 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-29 18:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:45 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for ZF51547: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68241%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for DW68241: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for GX07003: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08285%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for AE08285: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for BV75755: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46196%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for GZ46196: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13006%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for UW13006: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE35343%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for WE35343: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for VN12200: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP80129%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for WP80129: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST83220%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for ST83220: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ95012%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for TJ95012: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for BB55573: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53606%27 HTTP/1.1" 200 None
2026-03-29 18:35:45 [auto1.de] INFO: Scrape type for UA53606: 0
2026-03-29 18:35:45 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-29 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for AE82588: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for LS75303: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for PN52671: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH02312%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for VH02312: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN25217%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for NN25217: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for NL19683: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33608%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for SV33608: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for JW05859: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG26489%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for YG26489: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for GE22934: 0
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-29 18:35:46 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM09493%27 HTTP/1.1" 200 None
2026-03-29 18:35:46 [auto1.de] INFO: Scrape type for GM09493: 0
2026-03-29 18:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:47 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for UZ05424: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY40999%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for AY40999: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ28453%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for XZ28453: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83885%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for TU83885: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for ZU14307: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for EH26353: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for TU83793: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL70928%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for FL70928: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for ZU61192: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT35325%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for UT35325: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY62114%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for PY62114: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for UB19219: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG98905%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for NG98905: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC07133%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for JC07133: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52924%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for JR52924: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for MU38011: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM60144%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for KM60144: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for KP76789: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-29 18:35:47 [auto1.de] INFO: Scrape type for KM84276: 0
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-29 18:35:47 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-29 18:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:48 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for UM76387: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX96485%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for WX96485: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for BY37084: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63965%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for GC63965: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for UA30528: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for AF40281: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV92261%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for YV92261: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for YG24433: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for RK19274: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP45109%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for XP45109: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB06797%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for UB06797: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM44177%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for BM44177: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for AK88220: 0
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-29 18:35:48 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-29 18:35:48 [auto1.de] INFO: Scrape type for UP49415: 2
2026-03-29 18:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415
2026-03-29 18:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9af7212-3b09-5068-b733-f03063527caf with scrape type 2
2026-03-29 18:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9af7212-3b09-5068-b733-f03063527caf with scrape type 2
2026-03-29 18:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9af7212-3b09-5068-b733-f03063527caf, identifier: UP49415
2026-03-29 18:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415
2026-03-29 18:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415
2026-03-29 18:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415 to the API
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:45:43Z',
'fuel_type': 'diesel',
'id': 'd9af7212-3b09-5068-b733-f03063527caf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP49415',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 201758,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-22',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2014}
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Saving data for UP49415: {'auction_closing_time': 1774885543.0, 'created_time': 1773308105.866994, 'last_price_update_time': 1774809349.614402}
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP49415') HTTP/1.1" 204 0
2026-03-29 18:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM91896%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Scrape type for TM91896: 0
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ55203%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Scrape type for TZ55203: 0
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW83383%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Scrape type for XW83383: 0
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN59974%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Scrape type for DN59974: 0
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH47484%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Scrape type for TH47484: 0
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST09245%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Scrape type for ST09245: 0
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97766%27 HTTP/1.1" 200 None
2026-03-29 18:35:49 [auto1.de] INFO: Scrape type for TK97766: 0
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-29 18:35:49 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-29 18:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:50 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-29 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-29 18:35:50 [auto1.de] INFO: Scrape type for LN26385: 0
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-29 18:35:50 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-29 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for SR72775: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for JZ29670: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for LJ23138: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for VZ47534: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for HY14352: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for JD41613: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for EA70059: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for VY06306: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ70893%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for CZ70893: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC32133%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for HC32133: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for XB95476: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for HK91051: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN71628%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for RN71628: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for UV60068: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW93482%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for YW93482: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ85818%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for CJ85818: 0
2026-03-29 18:35:51 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM64848%27 HTTP/1.1" 200 None
2026-03-29 18:35:51 [auto1.de] INFO: Scrape type for CM64848: 0
2026-03-29 18:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:54 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW29670%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for MW29670: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86966%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for RC86966: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for TY40136: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG00548%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for BG00548: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for SP96872: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN44778%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for FN44778: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for MD51854: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for ZE88330: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85959%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for XY85959: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for EZ47162: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72786%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for YB72786: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX80950%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for TX80950: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28884%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for RM28884: 0
2026-03-29 18:35:54 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-29 18:35:54 [auto1.de] INFO: Scrape type for WJ79239: 2
2026-03-29 18:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239
2026-03-29 18:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with scrape type 2
2026-03-29 18:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with scrape type 2
2026-03-29 18:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1, identifier: WJ79239
2026-03-29 18:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239
2026-03-29 18:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239
2026-03-29 18:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239 to the API
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:57:29Z',
'fuel_type': 'petrol',
'id': 'c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ79239',
'listing': 'auction',
'make': 'Seat',
'model': 'Exeo',
'odometer': 190557,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'Seat Exeo 1.8 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2010}
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-29 18:35:55 [auto1.de] INFO: Saving data for WJ79239: {'auction_closing_time': 1774886249.0, 'created_time': 1773345548.901725, 'last_price_update_time': 1774809355.390401}
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ79239') HTTP/1.1" 204 0
2026-03-29 18:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:55 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA68744%27 HTTP/1.1" 200 None
2026-03-29 18:35:55 [auto1.de] INFO: Scrape type for HA68744: 0
2026-03-29 18:35:55 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-29 18:35:55 [auto1.de] INFO: Scrape type for FD80734: 2
2026-03-29 18:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734
2026-03-29 18:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with scrape type 2
2026-03-29 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with scrape type 2
2026-03-29 18:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb, identifier: FD80734
2026-03-29 18:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734
2026-03-29 18:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734
2026-03-29 18:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734 to the API
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:55:20Z',
'fuel_type': 'diesel',
'id': 'f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD80734',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Transporter',
'odometer': 49060,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-12',
'seller_name': None,
'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
'transmission': 'manual',
'trim': 'Kasten FWD',
'year': 2022}
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-29 18:35:55 [auto1.de] INFO: Saving data for FD80734: {'auction_closing_time': 1774886120.0, 'created_time': 1773301995.11854, 'last_price_update_time': 1774809355.965711}
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD80734') HTTP/1.1" 204 0
2026-03-29 18:35:55 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-29 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-29 18:35:56 [auto1.de] INFO: Scrape type for PV13799: 0
2026-03-29 18:35:56 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-29 18:35:56 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-29 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-29 18:35:56 [auto1.de] INFO: Scrape type for NT54414: 0
2026-03-29 18:35:56 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-29 18:35:56 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-29 18:35:56 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-29 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-29 18:35:56 [auto1.de] INFO: Scrape type for RE98096: 0
2026-03-29 18:35:56 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-29 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-29 18:35:56 [auto1.de] INFO: Scrape type for JR00588: 0
2026-03-29 18:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:57 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for RU42318: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for BZ91725: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for CK06472: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS80209%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for AS80209: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP67523%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for AP67523: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for SJ86823: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL43427%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for JL43427: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX27890%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for DX27890: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for AN60754: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH70293%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for EH70293: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR97756%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for NR97756: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for JX06129: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV57552%27 HTTP/1.1" 200 None
2026-03-29 18:35:57 [auto1.de] INFO: Scrape type for XV57552: 0
2026-03-29 18:35:57 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-29 18:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:35:58 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 6740 | hits on page: 40
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV35399%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for WV35399: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for DF56561: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for WX35600: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for MH82983: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM39918%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for MM39918: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ88627%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for YJ88627: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95202%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for AF95202: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV17111%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for XV17111: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for DV01319: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for EW76820: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for JK52723: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for GR38931: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for FS91363: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for AZ86702: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for ZR39968: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for PL85371: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for SL35659: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for GJ17165: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for VF37611: 0
2026-03-29 18:35:58 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-29 18:35:58 [auto1.de] INFO: Scrape type for ZU15284: 2
2026-03-29 18:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284
2026-03-29 18:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b060d60-9610-5aa4-b03d-34fd72987755 with scrape type 2
2026-03-29 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b060d60-9610-5aa4-b03d-34fd72987755 with scrape type 2
2026-03-29 18:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b060d60-9610-5aa4-b03d-34fd72987755, identifier: ZU15284
2026-03-29 18:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284
2026-03-29 18:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284
2026-03-29 18:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284 to the API
2026-03-29 18:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:06:24Z',
'fuel_type': 'petrol',
'id': '7b060d60-9610-5aa4-b03d-34fd72987755',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU15284',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 199299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-25',
'seller_name': None,
'title': 'Audi TT 2.0 TFSI Coupe',
'transmission': 'manual',
'trim': 'Coupe',
'year': 2008}
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-29 18:35:59 [auto1.de] INFO: Saving data for ZU15284: {'auction_closing_time': 1774883184.0, 'created_time': 1773131971.989757, 'last_price_update_time': 1774809359.44904}
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU15284') HTTP/1.1" 204 0
2026-03-29 18:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:00 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH01397%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Scrape type for VH01397: 0
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Scrape type for UR30493: 0
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD54213%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Scrape type for FD54213: 0
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Scrape type for JY95314: 0
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Scrape type for ZR98160: 0
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-29 18:36:00 [auto1.de] INFO: Scrape type for AM33807: 0
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-29 18:36:00 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG97845%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for MG97845: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for UM62946: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN76399%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for EN76399: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for CL40632: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW27373%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for TW27373: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12496%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for PR12496: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for PY00065: 2
2026-03-29 18:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065
2026-03-29 18:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with scrape type 2
2026-03-29 18:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with scrape type 2
2026-03-29 18:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747, identifier: PY00065
2026-03-29 18:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065
2026-03-29 18:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065
2026-03-29 18:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065 to the API
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:30:21Z',
'fuel_type': 'petrol',
'id': '1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY00065',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 148176,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-09',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TSI RS',
'transmission': 'manual',
'trim': 'RS',
'year': 2011}
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Saving data for PY00065: {'auction_closing_time': 1774884621.0, 'created_time': 1773303034.195269, 'last_price_update_time': 1774809361.705321}
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY00065') HTTP/1.1" 204 0
2026-03-29 18:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for HZ75916: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD41075%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for DD41075: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for VL75204: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for JY40414: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for KG80613: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for RB81159: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-29 18:36:01 [auto1.de] INFO: Scrape type for KM43405: 0
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-29 18:36:01 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-29 18:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:02 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM01437%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for JM01437: 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for YF03838: 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for CL60178: 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for AH10770: 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-29 18:36:02 [auto1.de] INFO: Scrape type for GE40777: 0
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-29 18:36:02 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA43023%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for TA43023: 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP47085%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for LP47085: 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD46825%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for VD46825: 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP83511%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for MP83511: 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for AK95286: 0
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for JG50197: 2
2026-03-29 18:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-29 18:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1a52c8-32fb-52bb-baa1-45002def6da1 with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d1a52c8-32fb-52bb-baa1-45002def6da1 with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d1a52c8-32fb-52bb-baa1-45002def6da1, identifier: JG50197
2026-03-29 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-29 18:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197 to the API
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:48:00Z',
'fuel_type': 'petrol',
'id': '8d1a52c8-32fb-52bb-baa1-45002def6da1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG50197',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 205500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-28',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Saving data for JG50197: {'auction_closing_time': 1774885680.0, 'created_time': 1774608302.013792, 'last_price_update_time': 1774809363.697173}
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG50197') HTTP/1.1" 204 0
2026-03-29 18:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:03 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-29 18:36:03 [auto1.de] INFO: Scrape type for XH92207: 2
2026-03-29 18:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-29 18:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e46331e9-982e-5737-98ed-b7250cfd202d with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e46331e9-982e-5737-98ed-b7250cfd202d with scrape type 2
2026-03-29 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e46331e9-982e-5737-98ed-b7250cfd202d, identifier: XH92207
2026-03-29 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-29 18:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-29 18:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207 to the API
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:11:30Z',
'fuel_type': 'petrol',
'id': 'e46331e9-982e-5737-98ed-b7250cfd202d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH92207',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 169795,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-25',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 150',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-29 18:36:04 [auto1.de] INFO: Saving data for XH92207: {'auction_closing_time': 1774883490.0, 'created_time': 1774608014.371783, 'last_price_update_time': 1774809364.262472}
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH92207') HTTP/1.1" 204 0
2026-03-29 18:36:04 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-29 18:36:04 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX71998%27 HTTP/1.1" 200 None
2026-03-29 18:36:04 [auto1.de] INFO: Scrape type for AX71998: 0
2026-03-29 18:36:04 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-29 18:36:04 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-29 18:36:04 [auto1.de] INFO: Scrape type for MN72943: 2
2026-03-29 18:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-29 18:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40caefae-b0d8-54bc-93cb-207ca0940897 with scrape type 2
2026-03-29 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40caefae-b0d8-54bc-93cb-207ca0940897 with scrape type 2
2026-03-29 18:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40caefae-b0d8-54bc-93cb-207ca0940897, identifier: MN72943
2026-03-29 18:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-29 18:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-29 18:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943 to the API
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:17:31Z',
'fuel_type': 'petrol',
'id': '40caefae-b0d8-54bc-93cb-207ca0940897',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN72943',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 126257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-01',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-29 18:36:04 [auto1.de] INFO: Saving data for MN72943: {'auction_closing_time': 1774883851.0, 'created_time': 1774607848.116328, 'last_price_update_time': 1774809364.854069}
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN72943') HTTP/1.1" 204 0
2026-03-29 18:36:04 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-29 18:36:04 [auto1.de] INFO: Scrape type for PH87632: 2
2026-03-29 18:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-29 18:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with scrape type 2
2026-03-29 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with scrape type 2
2026-03-29 18:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2, identifier: PH87632
2026-03-29 18:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-29 18:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-29 18:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632 to the API
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:25:57Z',
'fuel_type': 'diesel',
'id': '7340ca4f-9b8b-5f3a-8bfe-63527741aad2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH87632',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 104045,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 CDI Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2010}
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Saving data for PH87632: {'auction_closing_time': 1774884357.0, 'created_time': 1774608372.602594, 'last_price_update_time': 1774809365.30227}
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH87632') HTTP/1.1" 204 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for DK51297: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV07522%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for AV07522: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for ZA25327: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE47766%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for YE47766: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST92465%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for ST92465: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF33601%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for ZF33601: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69387%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for BP69387: 0
2026-03-29 18:36:05 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF83814%27 HTTP/1.1" 200 None
2026-03-29 18:36:05 [auto1.de] INFO: Scrape type for PF83814: 0
2026-03-29 18:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:06 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX35771%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for UX35771: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC73868%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for LC73868: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE89715%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for YE89715: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ87651%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for PZ87651: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR49956%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for WR49956: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU48519%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for EU48519: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS59554%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for HS59554: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU90894%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for VU90894: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL66084%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for AL66084: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31027%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for WF31027: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR46332%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for KR46332: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85982%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for YS85982: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50337%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for KC50337: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP14807%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for EP14807: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG49869%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for XG49869: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW53829%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for ZW53829: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE58616%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for CE58616: 0
2026-03-29 18:36:06 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Scrape type for KS98119: 2
2026-03-29 18:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119
2026-03-29 18:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with scrape type 2
2026-03-29 18:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with scrape type 2
2026-03-29 18:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420, identifier: KS98119
2026-03-29 18:36:06 [scrapy.extensions.logstats] INFO: Crawled 27 pages (at 27 pages/min), scraped 18 items (at 18 items/min)
2026-03-29 18:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119
2026-03-29 18:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119
2026-03-29 18:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420 with identifier: KS98119 to the API
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:43:51Z',
'fuel_type': 'petrol',
'id': 'ad9d83e1-0ff6-53f5-a9ab-331b5ffb3420',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS98119',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 109561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-22',
'seller_name': None,
'title': 'Dacia Duster 1.6 Destination 4x2',
'transmission': 'manual',
'trim': 'Destination 4x2',
'year': 2013}
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-29 18:36:06 [auto1.de] INFO: Saving data for KS98119: {'auction_closing_time': 1774885431.0, 'created_time': 1774031875.311433, 'last_price_update_time': 1774809366.994751}
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS98119') HTTP/1.1" 204 0
2026-03-29 18:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:07 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-29 18:36:07 [auto1.de] INFO: Scrape type for HW05295: 2
2026-03-29 18:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295
2026-03-29 18:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with scrape type 2
2026-03-29 18:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with scrape type 2
2026-03-29 18:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68, identifier: HW05295
2026-03-29 18:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 18:36:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295
2026-03-29 18:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a62b3d57-6c76-5bd4-8d11-6a222ca2ff68 with identifier: HW05295 to the API
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:03:41Z',
'fuel_type': 'hybrid',
'id': 'a62b3d57-6c76-5bd4-8d11-6a222ca2ff68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW05295',
'listing': 'auction',
'make': 'Honda',
'model': 'HR-V',
'odometer': 32867,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-28',
'seller_name': None,
'title': 'Honda HR-V 1.5 i-MMD Hybrid Advance',
'transmission': 'automatic',
'trim': 'Advance',
'year': 2022}
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-29 18:36:07 [auto1.de] INFO: Saving data for HW05295: {'auction_closing_time': 1774883021.0, 'created_time': 1774003285.758218, 'last_price_update_time': 1774809367.665237}
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW05295') HTTP/1.1" 204 0
2026-03-29 18:36:07 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-29 18:36:07 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-29 18:36:07 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-29 18:36:07 [auto1.de] INFO: Scrape type for DK12229: 2
2026-03-29 18:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229
2026-03-29 18:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 820f7486-e6f3-568c-a1bd-be862f6302bb with scrape type 2
2026-03-29 18:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 820f7486-e6f3-568c-a1bd-be862f6302bb with scrape type 2
2026-03-29 18:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 820f7486-e6f3-568c-a1bd-be862f6302bb, identifier: DK12229
2026-03-29 18:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229
2026-03-29 18:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229
2026-03-29 18:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 820f7486-e6f3-568c-a1bd-be862f6302bb with identifier: DK12229 to the API
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:22:56Z',
'fuel_type': 'diesel',
'id': '820f7486-e6f3-568c-a1bd-be862f6302bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK12229',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 119133,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-26',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Lounge Sport & Style 4Motion BlueMotion',
'year': 2015}
2026-03-29 18:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-29 18:36:08 [auto1.de] INFO: Saving data for DK12229: {'auction_closing_time': 1774884176.0, 'created_time': 1773381497.085018, 'last_price_update_time': 1774809368.081674}
2026-03-29 18:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK12229') HTTP/1.1" 204 0
2026-03-29 18:36:08 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-29 18:36:08 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-29 18:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-29 18:36:08 [auto1.de] INFO: Scrape type for YB47390: 2
2026-03-29 18:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390
2026-03-29 18:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e574adbe-c877-5974-90f2-095ae8626b1e with scrape type 2
2026-03-29 18:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e574adbe-c877-5974-90f2-095ae8626b1e with scrape type 2
2026-03-29 18:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e574adbe-c877-5974-90f2-095ae8626b1e, identifier: YB47390
2026-03-29 18:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390
2026-03-29 18:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390
2026-03-29 18:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e574adbe-c877-5974-90f2-095ae8626b1e with identifier: YB47390 to the API
2026-03-29 18:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:02:31Z',
'fuel_type': 'petrol',
'id': 'e574adbe-c877-5974-90f2-095ae8626b1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB47390',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 203052,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-29 18:36:09 [auto1.de] INFO: Saving data for YB47390: {'auction_closing_time': 1774882951.0, 'created_time': 1774033307.244952, 'last_price_update_time': 1774809369.380333}
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB47390') HTTP/1.1" 204 0
2026-03-29 18:36:09 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-29 18:36:09 [auto1.de] INFO: Scrape type for VX00455: 2
2026-03-29 18:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455
2026-03-29 18:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with scrape type 2
2026-03-29 18:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with scrape type 2
2026-03-29 18:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1, identifier: VX00455
2026-03-29 18:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 18:36:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455
2026-03-29 18:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1 with identifier: VX00455 to the API
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:12:38Z',
'fuel_type': 'petrol',
'id': 'bf5b8c5f-c582-5ca0-bccb-c763dd8cc4c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX00455',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 85341,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-15',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2005}
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-29 18:36:09 [auto1.de] INFO: Saving data for VX00455: {'auction_closing_time': 1774883558.0, 'created_time': 1774033544.186554, 'last_price_update_time': 1774809369.927865}
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX00455') HTTP/1.1" 204 0
2026-03-29 18:36:09 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07399%27 HTTP/1.1" 200 None
2026-03-29 18:36:09 [auto1.de] INFO: Scrape type for VW07399: 2
2026-03-29 18:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399
2026-03-29 18:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with scrape type 2
2026-03-29 18:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with scrape type 2
2026-03-29 18:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d, identifier: VW07399
2026-03-29 18:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399
2026-03-29 18:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399
2026-03-29 18:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff7cb189-f878-5ccd-b5d6-6a08b496cf4d with identifier: VW07399 to the API
2026-03-29 18:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:48:18Z',
'fuel_type': 'petrol',
'id': 'ff7cb189-f878-5ccd-b5d6-6a08b496cf4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW07399',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 121502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-26',
'seller_name': None,
'title': 'Hyundai i10 1.1 FIFA WM Edition',
'transmission': 'manual',
'trim': 'FIFA WM Edition',
'year': 2011}
2026-03-29 18:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07399%27 HTTP/1.1" 200 None
2026-03-29 18:36:10 [auto1.de] INFO: Saving data for VW07399: {'auction_closing_time': 1774885698.0, 'created_time': 1774722933.67837, 'last_price_update_time': 1774809370.336883}
2026-03-29 18:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW07399') HTTP/1.1" 204 0
2026-03-29 18:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:11 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:11 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-29 18:36:11 [auto1.de] INFO: Scrape type for SZ67140: 2
2026-03-29 18:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140
2026-03-29 18:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca144f1c-4a0a-5d87-a449-18bc4f514b23 with scrape type 2
2026-03-29 18:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca144f1c-4a0a-5d87-a449-18bc4f514b23 with scrape type 2
2026-03-29 18:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca144f1c-4a0a-5d87-a449-18bc4f514b23, identifier: SZ67140
2026-03-29 18:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140
2026-03-29 18:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140
2026-03-29 18:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca144f1c-4a0a-5d87-a449-18bc4f514b23 with identifier: SZ67140 to the API
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:22:53Z',
'fuel_type': 'petrol',
'id': 'ca144f1c-4a0a-5d87-a449-18bc4f514b23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ67140',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 47883,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-15',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2019}
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-29 18:36:11 [auto1.de] INFO: Saving data for SZ67140: {'auction_closing_time': 1774884173.0, 'created_time': 1774034677.566655, 'last_price_update_time': 1774809371.495642}
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ67140') HTTP/1.1" 204 0
2026-03-29 18:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:11 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-29 18:36:11 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-29 18:36:11 [auto1.de] INFO: Scrape type for HT40242: 2
2026-03-29 18:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242
2026-03-29 18:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541cd21e-efad-57ff-965e-bf3d0dde4fed with scrape type 2
2026-03-29 18:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541cd21e-efad-57ff-965e-bf3d0dde4fed with scrape type 2
2026-03-29 18:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541cd21e-efad-57ff-965e-bf3d0dde4fed, identifier: HT40242
2026-03-29 18:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242
2026-03-29 18:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242
2026-03-29 18:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541cd21e-efad-57ff-965e-bf3d0dde4fed with identifier: HT40242 to the API
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 72,
'expiration_date': '2026-03-30T15:14:44Z',
'fuel_type': 'petrol',
'id': '541cd21e-efad-57ff-965e-bf3d0dde4fed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT40242',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 126891,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-04',
'seller_name': None,
'title': 'Toyota Aygo 1.0-VVT-i X-Play Connect',
'transmission': 'manual',
'trim': 'X-Play Connect',
'year': 2018}
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-29 18:36:11 [auto1.de] INFO: Saving data for HT40242: {'auction_closing_time': 1774883684.0, 'created_time': 1774350822.15705, 'last_price_update_time': 1774809371.913728}
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT40242') HTTP/1.1" 204 0
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-29 18:36:12 [auto1.de] INFO: Scrape type for AC96507: 2
2026-03-29 18:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507
2026-03-29 18:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e14343e3-ac3c-5b95-8ffc-3018fb6081dd with scrape type 2
2026-03-29 18:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e14343e3-ac3c-5b95-8ffc-3018fb6081dd with scrape type 2
2026-03-29 18:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e14343e3-ac3c-5b95-8ffc-3018fb6081dd, identifier: AC96507
2026-03-29 18:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507
2026-03-29 18:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507
2026-03-29 18:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e14343e3-ac3c-5b95-8ffc-3018fb6081dd with identifier: AC96507 to the API
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:24:47Z',
'fuel_type': 'petrol',
'id': 'e14343e3-ac3c-5b95-8ffc-3018fb6081dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC96507',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Bayon',
'odometer': 79806,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-29',
'seller_name': None,
'title': 'Hyundai Bayon 1.0 TGDI Intro Edition 2WD',
'transmission': 'manual',
'trim': 'Intro Edition 2WD',
'year': 2022}
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-29 18:36:12 [auto1.de] INFO: Saving data for AC96507: {'auction_closing_time': 1774884287.0, 'created_time': 1773341258.079326, 'last_price_update_time': 1774809372.422712}
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC96507') HTTP/1.1" 204 0
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-29 18:36:12 [auto1.de] INFO: Scrape type for YS65782: 2
2026-03-29 18:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782
2026-03-29 18:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d99ae1bc-2440-504e-9516-fb1e880c2748 with scrape type 2
2026-03-29 18:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d99ae1bc-2440-504e-9516-fb1e880c2748 with scrape type 2
2026-03-29 18:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d99ae1bc-2440-504e-9516-fb1e880c2748, identifier: YS65782
2026-03-29 18:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782
2026-03-29 18:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782
2026-03-29 18:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d99ae1bc-2440-504e-9516-fb1e880c2748 with identifier: YS65782 to the API
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:28:01Z',
'fuel_type': 'petrol',
'id': 'd99ae1bc-2440-504e-9516-fb1e880c2748',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS65782',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Lancer',
'odometer': 266427,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-19',
'seller_name': None,
'title': 'Mitsubishi Lancer 1.8 DOHC Intense',
'transmission': 'automatic',
'trim': 'Intense',
'year': 2009}
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-29 18:36:12 [auto1.de] INFO: Saving data for YS65782: {'auction_closing_time': 1774884481.0, 'created_time': 1774118663.785543, 'last_price_update_time': 1774809372.840623}
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS65782') HTTP/1.1" 204 0
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-29 18:36:12 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-29 18:36:12 [auto1.de] INFO: Scrape type for ZU40023: 2
2026-03-29 18:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023
2026-03-29 18:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with scrape type 2
2026-03-29 18:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with scrape type 2
2026-03-29 18:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8069ed36-6f78-5211-bf0a-1362cc5e62c1, identifier: ZU40023
2026-03-29 18:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023
2026-03-29 18:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023
2026-03-29 18:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8069ed36-6f78-5211-bf0a-1362cc5e62c1 with identifier: ZU40023 to the API
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:15:06Z',
'fuel_type': 'diesel',
'id': '8069ed36-6f78-5211-bf0a-1362cc5e62c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU40023',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 33615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-27',
'seller_name': None,
'title': 'Audi Q5 40 TDI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2022}
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-29 18:36:13 [auto1.de] INFO: Saving data for ZU40023: {'auction_closing_time': 1774883706.0, 'created_time': 1774034979.068991, 'last_price_update_time': 1774809373.24287}
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU40023') HTTP/1.1" 204 0
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-29 18:36:13 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-29 18:36:13 [auto1.de] INFO: Scrape type for AY96814: 2
2026-03-29 18:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814
2026-03-29 18:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd600ef-6ecf-5883-ab91-ff48320495e2 with scrape type 2
2026-03-29 18:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd600ef-6ecf-5883-ab91-ff48320495e2 with scrape type 2
2026-03-29 18:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd600ef-6ecf-5883-ab91-ff48320495e2, identifier: AY96814
2026-03-29 18:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814
2026-03-29 18:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814
2026-03-29 18:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd600ef-6ecf-5883-ab91-ff48320495e2 with identifier: AY96814 to the API
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:10:37Z',
'fuel_type': 'petrol',
'id': '5fd600ef-6ecf-5883-ab91-ff48320495e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY96814',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 144434,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-28',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2006}
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-29 18:36:13 [auto1.de] INFO: Saving data for AY96814: {'auction_closing_time': 1774883437.0, 'created_time': 1773305293.202306, 'last_price_update_time': 1774809373.70194}
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY96814') HTTP/1.1" 204 0
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-29 18:36:13 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-29 18:36:13 [auto1.de] INFO: Scrape type for PT29857: 2
2026-03-29 18:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857
2026-03-29 18:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c1f861-41f0-5ee5-95ab-02982fcb771e with scrape type 2
2026-03-29 18:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6c1f861-41f0-5ee5-95ab-02982fcb771e with scrape type 2
2026-03-29 18:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6c1f861-41f0-5ee5-95ab-02982fcb771e, identifier: PT29857
2026-03-29 18:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857
2026-03-29 18:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857
2026-03-29 18:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6c1f861-41f0-5ee5-95ab-02982fcb771e with identifier: PT29857 to the API
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:59:41Z',
'fuel_type': 'petrol',
'id': 'f6c1f861-41f0-5ee5-95ab-02982fcb771e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT29857',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 202857,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-06-28',
'seller_name': None,
'title': 'Audi A4 1.8 Turbo',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-29 18:36:14 [auto1.de] INFO: Saving data for PT29857: {'auction_closing_time': 1774886381.0, 'created_time': 1774118888.600873, 'last_price_update_time': 1774809374.211599}
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT29857') HTTP/1.1" 204 0
2026-03-29 18:36:14 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-29 18:36:14 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-29 18:36:14 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-29 18:36:14 [auto1.de] INFO: Scrape type for WA25791: 2
2026-03-29 18:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791
2026-03-29 18:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e0f0cb-5794-56ad-a202-36fbe06a8ead with scrape type 2
2026-03-29 18:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e0f0cb-5794-56ad-a202-36fbe06a8ead with scrape type 2
2026-03-29 18:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e0f0cb-5794-56ad-a202-36fbe06a8ead, identifier: WA25791
2026-03-29 18:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791
2026-03-29 18:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791
2026-03-29 18:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e0f0cb-5794-56ad-a202-36fbe06a8ead with identifier: WA25791 to the API
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:15:32Z',
'fuel_type': 'petrol',
'id': '68e0f0cb-5794-56ad-a202-36fbe06a8ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA25791',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 81679,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-27',
'seller_name': None,
'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-29 18:36:14 [auto1.de] INFO: Saving data for WA25791: {'auction_closing_time': 1774883732.0, 'created_time': 1774089697.001036, 'last_price_update_time': 1774809374.621477}
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA25791') HTTP/1.1" 204 0
2026-03-29 18:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:14 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-29 18:36:14 [auto1.de] INFO: Scrape type for LN99770: 2
2026-03-29 18:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-29 18:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c753a4-038b-59b2-a066-d050d99b5419 with scrape type 2
2026-03-29 18:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c753a4-038b-59b2-a066-d050d99b5419 with scrape type 2
2026-03-29 18:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c753a4-038b-59b2-a066-d050d99b5419, identifier: LN99770
2026-03-29 18:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 18:36:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770
2026-03-29 18:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c753a4-038b-59b2-a066-d050d99b5419 with identifier: LN99770 to the API
2026-03-29 18:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:17Z',
'fuel_type': 'diesel',
'id': 'c8c753a4-038b-59b2-a066-d050d99b5419',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN99770',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 94317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-01',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2015}
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-29 18:36:15 [auto1.de] INFO: Saving data for LN99770: {'auction_closing_time': 1774885277.0, 'created_time': 1774350053.46097, 'last_price_update_time': 1774809375.152259}
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN99770') HTTP/1.1" 204 0
2026-03-29 18:36:15 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-29 18:36:15 [auto1.de] INFO: Scrape type for NK17990: 2
2026-03-29 18:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-29 18:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1f83260-43d5-5574-a4fa-6b450a2b209e with scrape type 2
2026-03-29 18:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1f83260-43d5-5574-a4fa-6b450a2b209e with scrape type 2
2026-03-29 18:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1f83260-43d5-5574-a4fa-6b450a2b209e, identifier: NK17990
2026-03-29 18:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-29 18:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990
2026-03-29 18:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1f83260-43d5-5574-a4fa-6b450a2b209e with identifier: NK17990 to the API
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:41Z',
'fuel_type': 'petrol',
'id': 'e1f83260-43d5-5574-a4fa-6b450a2b209e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK17990',
'listing': 'auction',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 104324,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-11',
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
'transmission': 'automatic',
'trim': 'INNOVATION',
'year': 2018}
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-29 18:36:15 [auto1.de] INFO: Saving data for NK17990: {'auction_closing_time': 1774883981.0, 'created_time': 1774031835.568954, 'last_price_update_time': 1774809375.565684}
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK17990') HTTP/1.1" 204 0
2026-03-29 18:36:15 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:15 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY43451%27 HTTP/1.1" 200 None
2026-03-29 18:36:15 [auto1.de] INFO: Scrape type for CY43451: 2
2026-03-29 18:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451
2026-03-29 18:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358f8608-f8f9-5d8b-8015-9f99a01cea36 with scrape type 2
2026-03-29 18:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 358f8608-f8f9-5d8b-8015-9f99a01cea36 with scrape type 2
2026-03-29 18:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 358f8608-f8f9-5d8b-8015-9f99a01cea36, identifier: CY43451
2026-03-29 18:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451
2026-03-29 18:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451
2026-03-29 18:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 358f8608-f8f9-5d8b-8015-9f99a01cea36 with identifier: CY43451 to the API
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:10:18Z',
'fuel_type': 'diesel',
'id': '358f8608-f8f9-5d8b-8015-9f99a01cea36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY43451',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 131679,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-27',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI Alltrack 4Motion',
'transmission': 'automatic',
'trim': 'Alltrack 4Motion',
'year': 2022}
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY43451%27 HTTP/1.1" 200 None
2026-03-29 18:36:15 [auto1.de] INFO: Saving data for CY43451: {'auction_closing_time': 1774883418.0, 'created_time': 1774722938.857839, 'last_price_update_time': 1774809375.976778}
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY43451') HTTP/1.1" 204 0
2026-03-29 18:36:15 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59005%27 HTTP/1.1" 200 None
2026-03-29 18:36:16 [auto1.de] INFO: Scrape type for DS59005: 2
2026-03-29 18:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005
2026-03-29 18:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24ad860-2529-5a91-b5e6-d2722b200446 with scrape type 2
2026-03-29 18:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24ad860-2529-5a91-b5e6-d2722b200446 with scrape type 2
2026-03-29 18:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a24ad860-2529-5a91-b5e6-d2722b200446, identifier: DS59005
2026-03-29 18:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:16 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-29 18:36:16 [auto1.de] INFO: Scrape type for ZX96561: 2
2026-03-29 18:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-29 18:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82935d13-c601-511d-afeb-cc596b21a7b2 with scrape type 2
2026-03-29 18:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82935d13-c601-511d-afeb-cc596b21a7b2 with scrape type 2
2026-03-29 18:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82935d13-c601-511d-afeb-cc596b21a7b2, identifier: ZX96561
2026-03-29 18:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005
2026-03-29 18:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005
2026-03-29 18:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a24ad860-2529-5a91-b5e6-d2722b200446 with identifier: DS59005 to the API
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:32:13Z',
'fuel_type': 'diesel',
'id': 'a24ad860-2529-5a91-b5e6-d2722b200446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS59005',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 246444,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-20',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2015}
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59005%27 HTTP/1.1" 200 None
2026-03-29 18:36:16 [auto1.de] INFO: Saving data for DS59005: {'auction_closing_time': 1774884733.0, 'created_time': 1774032145.47049, 'last_price_update_time': 1774809376.474621}
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS59005') HTTP/1.1" 204 0
2026-03-29 18:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-29 18:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561
2026-03-29 18:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82935d13-c601-511d-afeb-cc596b21a7b2 with identifier: ZX96561 to the API
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 83,
'expiration_date': '2026-03-30T15:05:15Z',
'fuel_type': 'petrol',
'id': '82935d13-c601-511d-afeb-cc596b21a7b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX96561',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 114680,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-21',
'seller_name': None,
'title': 'Honda Civic 1.4 DSi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2008}
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-29 18:36:16 [auto1.de] INFO: Saving data for ZX96561: {'auction_closing_time': 1774883115.0, 'created_time': 1774033878.718627, 'last_price_update_time': 1774809376.852939}
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX96561') HTTP/1.1" 204 0
2026-03-29 18:36:16 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-29 18:36:16 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV48558%27 HTTP/1.1" 200 None
2026-03-29 18:36:16 [auto1.de] INFO: Scrape type for JV48558: 2
2026-03-29 18:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558
2026-03-29 18:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc87eaf-732b-563e-8798-2fc15356553d with scrape type 2
2026-03-29 18:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc87eaf-732b-563e-8798-2fc15356553d with scrape type 2
2026-03-29 18:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffc87eaf-732b-563e-8798-2fc15356553d, identifier: JV48558
2026-03-29 18:36:16 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-29 18:36:16 [auto1.de] INFO: Scrape type for LX79709: 2
2026-03-29 18:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-29 18:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6c23cf-ba3b-5a46-adc1-0e4791931deb with scrape type 2
2026-03-29 18:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb6c23cf-ba3b-5a46-adc1-0e4791931deb with scrape type 2
2026-03-29 18:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb6c23cf-ba3b-5a46-adc1-0e4791931deb, identifier: LX79709
2026-03-29 18:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558
2026-03-29 18:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558
2026-03-29 18:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffc87eaf-732b-563e-8798-2fc15356553d with identifier: JV48558 to the API
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:54:33Z',
'fuel_type': 'petrol',
'id': 'ffc87eaf-732b-563e-8798-2fc15356553d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV48558',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 116712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-26',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV48558%27 HTTP/1.1" 200 None
2026-03-29 18:36:17 [auto1.de] INFO: Saving data for JV48558: {'auction_closing_time': 1774886073.0, 'created_time': 1774033654.986265, 'last_price_update_time': 1774809377.365666}
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV48558') HTTP/1.1" 204 0
2026-03-29 18:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-29 18:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709
2026-03-29 18:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb6c23cf-ba3b-5a46-adc1-0e4791931deb with identifier: LX79709 to the API
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:13:02Z',
'fuel_type': 'diesel',
'id': 'bb6c23cf-ba3b-5a46-adc1-0e4791931deb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX79709',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 381825,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-31',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Match BlueMotion',
'transmission': 'automatic',
'trim': 'Match BlueMotion',
'year': 2013}
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-29 18:36:17 [auto1.de] INFO: Saving data for LX79709: {'auction_closing_time': 1774883582.0, 'created_time': 1774034104.510288, 'last_price_update_time': 1774809377.67649}
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX79709') HTTP/1.1" 204 0
2026-03-29 18:36:17 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-29 18:36:17 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH54346%27 HTTP/1.1" 200 None
2026-03-29 18:36:17 [auto1.de] INFO: Scrape type for LH54346: 2
2026-03-29 18:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346
2026-03-29 18:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da3893a-91a0-52f9-83c2-df225296d56e with scrape type 2
2026-03-29 18:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da3893a-91a0-52f9-83c2-df225296d56e with scrape type 2
2026-03-29 18:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5da3893a-91a0-52f9-83c2-df225296d56e, identifier: LH54346
2026-03-29 18:36:17 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50640%27 HTTP/1.1" 200 None
2026-03-29 18:36:17 [auto1.de] INFO: Scrape type for KC50640: 2
2026-03-29 18:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640
2026-03-29 18:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14283376-e4a1-531b-9e42-8c7ba6fc502f with scrape type 2
2026-03-29 18:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14283376-e4a1-531b-9e42-8c7ba6fc502f with scrape type 2
2026-03-29 18:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14283376-e4a1-531b-9e42-8c7ba6fc502f, identifier: KC50640
2026-03-29 18:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346
2026-03-29 18:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346
2026-03-29 18:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5da3893a-91a0-52f9-83c2-df225296d56e with identifier: LH54346 to the API
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:35:57Z',
'fuel_type': 'petrol',
'id': '5da3893a-91a0-52f9-83c2-df225296d56e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH54346',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 66303,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-06',
'seller_name': None,
'title': 'BMW X1 sDrive 18i Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2018}
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH54346%27 HTTP/1.1" 200 None
2026-03-29 18:36:18 [auto1.de] INFO: Saving data for LH54346: {'auction_closing_time': 1774884957.0, 'created_time': 1773426989.221201, 'last_price_update_time': 1774809378.290182}
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH54346') HTTP/1.1" 204 0
2026-03-29 18:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640
2026-03-29 18:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640
2026-03-29 18:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14283376-e4a1-531b-9e42-8c7ba6fc502f with identifier: KC50640 to the API
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:07:43Z',
'fuel_type': 'diesel',
'id': '14283376-e4a1-531b-9e42-8c7ba6fc502f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC50640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 221452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-17',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50640%27 HTTP/1.1" 200 None
2026-03-29 18:36:18 [auto1.de] INFO: Saving data for KC50640: {'auction_closing_time': 1774883263.0, 'created_time': 1774032327.744975, 'last_price_update_time': 1774809378.572408}
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC50640') HTTP/1.1" 204 0
2026-03-29 18:36:18 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-29 18:36:18 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-29 18:36:18 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-29 18:36:18 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-29 18:36:18 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-29 18:36:18 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX21647%27 HTTP/1.1" 200 None
2026-03-29 18:36:18 [auto1.de] INFO: Scrape type for JX21647: 2
2026-03-29 18:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647
2026-03-29 18:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca277e76-00a2-5deb-9089-2392cfb55009 with scrape type 2
2026-03-29 18:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca277e76-00a2-5deb-9089-2392cfb55009 with scrape type 2
2026-03-29 18:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca277e76-00a2-5deb-9089-2392cfb55009, identifier: JX21647
2026-03-29 18:36:18 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR60747%27 HTTP/1.1" 200 None
2026-03-29 18:36:18 [auto1.de] INFO: Scrape type for VR60747: 2
2026-03-29 18:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747
2026-03-29 18:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04167ce4-9513-5dba-9969-eeebeda8f5bf with scrape type 2
2026-03-29 18:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04167ce4-9513-5dba-9969-eeebeda8f5bf with scrape type 2
2026-03-29 18:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04167ce4-9513-5dba-9969-eeebeda8f5bf, identifier: VR60747
2026-03-29 18:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647
2026-03-29 18:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647
2026-03-29 18:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca277e76-00a2-5deb-9089-2392cfb55009 with identifier: JX21647 to the API
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:19:20Z',
'fuel_type': 'diesel',
'id': 'ca277e76-00a2-5deb-9089-2392cfb55009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX21647',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC70',
'odometer': 249871,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-06',
'seller_name': None,
'title': 'Volvo XC70 2.4 D5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2007}
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX21647%27 HTTP/1.1" 200 None
2026-03-29 18:36:19 [auto1.de] INFO: Saving data for JX21647: {'auction_closing_time': 1774883960.0, 'created_time': 1773429539.771537, 'last_price_update_time': 1774809379.104228}
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX21647') HTTP/1.1" 204 0
2026-03-29 18:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747
2026-03-29 18:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747
2026-03-29 18:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04167ce4-9513-5dba-9969-eeebeda8f5bf with identifier: VR60747 to the API
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:04Z',
'fuel_type': 'diesel',
'id': '04167ce4-9513-5dba-9969-eeebeda8f5bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR60747',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 136187,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-29',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR60747%27 HTTP/1.1" 200 None
2026-03-29 18:36:19 [auto1.de] INFO: Saving data for VR60747: {'auction_closing_time': 1774884604.0, 'created_time': 1773383487.567235, 'last_price_update_time': 1774809379.531914}
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR60747') HTTP/1.1" 204 0
2026-03-29 18:36:19 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU30885%27 HTTP/1.1" 200 None
2026-03-29 18:36:19 [auto1.de] INFO: Scrape type for VU30885: 2
2026-03-29 18:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885
2026-03-29 18:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7332a38-ae61-561d-bc59-e9a447d43851 with scrape type 2
2026-03-29 18:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7332a38-ae61-561d-bc59-e9a447d43851 with scrape type 2
2026-03-29 18:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7332a38-ae61-561d-bc59-e9a447d43851, identifier: VU30885
2026-03-29 18:36:19 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ06147%27 HTTP/1.1" 200 None
2026-03-29 18:36:19 [auto1.de] INFO: Scrape type for SZ06147: 2
2026-03-29 18:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147
2026-03-29 18:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with scrape type 2
2026-03-29 18:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with scrape type 2
2026-03-29 18:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a, identifier: SZ06147
2026-03-29 18:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885
2026-03-29 18:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885
2026-03-29 18:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7332a38-ae61-561d-bc59-e9a447d43851 with identifier: VU30885 to the API
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:17Z',
'fuel_type': 'diesel',
'id': 'a7332a38-ae61-561d-bc59-e9a447d43851',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU30885',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 110915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-12',
'seller_name': None,
'title': 'BMW 1er 118d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2016}
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU30885%27 HTTP/1.1" 200 None
2026-03-29 18:36:20 [auto1.de] INFO: Saving data for VU30885: {'auction_closing_time': 1774884737.0, 'created_time': 1773427294.805044, 'last_price_update_time': 1774809380.076165}
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU30885') HTTP/1.1" 204 0
2026-03-29 18:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147
2026-03-29 18:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147
2026-03-29 18:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a63b3f8-a051-5fb6-9ec7-d265e880ec4a with identifier: SZ06147 to the API
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:10:12Z',
'fuel_type': 'diesel',
'id': '4a63b3f8-a051-5fb6-9ec7-d265e880ec4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ06147',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 93556,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-03',
'seller_name': None,
'title': 'Fiat Ducato 2.3 JTD 130',
'transmission': 'manual',
'trim': '130',
'year': 2014}
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ06147%27 HTTP/1.1" 200 None
2026-03-29 18:36:20 [auto1.de] INFO: Saving data for SZ06147: {'auction_closing_time': 1774883412.0, 'created_time': 1773383236.134235, 'last_price_update_time': 1774809380.368553}
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ06147') HTTP/1.1" 204 0
2026-03-29 18:36:20 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90627%27 HTTP/1.1" 200 None
2026-03-29 18:36:20 [auto1.de] INFO: Scrape type for MM90627: 2
2026-03-29 18:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627
2026-03-29 18:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef926eb4-aeb7-568f-8ce7-366ff306a319 with scrape type 2
2026-03-29 18:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef926eb4-aeb7-568f-8ce7-366ff306a319 with scrape type 2
2026-03-29 18:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef926eb4-aeb7-568f-8ce7-366ff306a319, identifier: MM90627
2026-03-29 18:36:20 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-29 18:36:20 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV70278%27 HTTP/1.1" 200 None
2026-03-29 18:36:20 [auto1.de] INFO: Scrape type for NV70278: 2
2026-03-29 18:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278
2026-03-29 18:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with scrape type 2
2026-03-29 18:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with scrape type 2
2026-03-29 18:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c, identifier: NV70278
2026-03-29 18:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627
2026-03-29 18:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627
2026-03-29 18:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef926eb4-aeb7-568f-8ce7-366ff306a319 with identifier: MM90627 to the API
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:52:41Z',
'fuel_type': 'petrol',
'id': 'ef926eb4-aeb7-568f-8ce7-366ff306a319',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM90627',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 177358,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-18',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Match BlueMotion',
'transmission': 'manual',
'trim': 'Match BlueMotion',
'year': 2012}
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90627%27 HTTP/1.1" 200 None
2026-03-29 18:36:20 [auto1.de] INFO: Saving data for MM90627: {'auction_closing_time': 1774885961.0, 'created_time': 1774089528.919424, 'last_price_update_time': 1774809380.880726}
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM90627') HTTP/1.1" 204 0
2026-03-29 18:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278
2026-03-29 18:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278
2026-03-29 18:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 742b7ad3-9a4c-57a5-a8d1-3516c96f386c with identifier: NV70278 to the API
2026-03-29 18:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:29:53Z',
'fuel_type': 'diesel',
'id': '742b7ad3-9a4c-57a5-a8d1-3516c96f386c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV70278',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 241637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-09',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 220 CDI BlueEfficiency AMG Sport',
'transmission': 'automatic',
'trim': 'BlueEfficiency AMG Sport',
'year': 2013}
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV70278%27 HTTP/1.1" 200 None
2026-03-29 18:36:21 [auto1.de] INFO: Saving data for NV70278: {'auction_closing_time': 1774884593.0, 'created_time': 1774350274.231879, 'last_price_update_time': 1774809381.193184}
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV70278') HTTP/1.1" 204 0
2026-03-29 18:36:21 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-29 18:36:21 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-29 18:36:21 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-29 18:36:21 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-29 18:36:21 [auto1.de] INFO: Scrape type for JG03809: 2
2026-03-29 18:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809
2026-03-29 18:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d86a5e6e-f3e0-5cb2-b815-f62777885c16 with scrape type 2
2026-03-29 18:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d86a5e6e-f3e0-5cb2-b815-f62777885c16 with scrape type 2
2026-03-29 18:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d86a5e6e-f3e0-5cb2-b815-f62777885c16, identifier: JG03809
2026-03-29 18:36:21 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL59344%27 HTTP/1.1" 200 None
2026-03-29 18:36:21 [auto1.de] INFO: Scrape type for ZL59344: 2
2026-03-29 18:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344
2026-03-29 18:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff85131-00d4-5279-8b97-f28c34485a13 with scrape type 2
2026-03-29 18:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ff85131-00d4-5279-8b97-f28c34485a13 with scrape type 2
2026-03-29 18:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ff85131-00d4-5279-8b97-f28c34485a13, identifier: ZL59344
2026-03-29 18:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809
2026-03-29 18:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809
2026-03-29 18:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d86a5e6e-f3e0-5cb2-b815-f62777885c16 with identifier: JG03809 to the API
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:54Z',
'fuel_type': 'petrol',
'id': 'd86a5e6e-f3e0-5cb2-b815-f62777885c16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG03809',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 42770,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-17',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2021}
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-29 18:36:21 [auto1.de] INFO: Saving data for JG03809: {'auction_closing_time': 1774885194.0, 'created_time': 1774722953.289349, 'last_price_update_time': 1774809381.702174}
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG03809') HTTP/1.1" 204 0
2026-03-29 18:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344
2026-03-29 18:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344
2026-03-29 18:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ff85131-00d4-5279-8b97-f28c34485a13 with identifier: ZL59344 to the API
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:12:44Z',
'fuel_type': 'diesel',
'id': '9ff85131-00d4-5279-8b97-f28c34485a13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL59344',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 55605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-12',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 18:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL59344%27 HTTP/1.1" 200 None
2026-03-29 18:36:22 [auto1.de] INFO: Saving data for ZL59344: {'auction_closing_time': 1774883564.0, 'created_time': 1773306251.274197, 'last_price_update_time': 1774809382.005592}
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL59344') HTTP/1.1" 204 0
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV85598%27 HTTP/1.1" 200 None
2026-03-29 18:36:22 [auto1.de] INFO: Scrape type for YV85598: 2
2026-03-29 18:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598
2026-03-29 18:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603b3f55-b0d1-5f34-becc-a4d98a1e102a with scrape type 2
2026-03-29 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 603b3f55-b0d1-5f34-becc-a4d98a1e102a with scrape type 2
2026-03-29 18:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 603b3f55-b0d1-5f34-becc-a4d98a1e102a, identifier: YV85598
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-29 18:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598
2026-03-29 18:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598
2026-03-29 18:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 603b3f55-b0d1-5f34-becc-a4d98a1e102a with identifier: YV85598 to the API
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:40:12Z',
'fuel_type': 'diesel',
'id': '603b3f55-b0d1-5f34-becc-a4d98a1e102a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV85598',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 268904,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-30',
'seller_name': None,
'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV85598%27 HTTP/1.1" 200 None
2026-03-29 18:36:22 [auto1.de] INFO: Saving data for YV85598: {'auction_closing_time': 1774885212.0, 'created_time': 1774722953.625629, 'last_price_update_time': 1774809382.415623}
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV85598') HTTP/1.1" 204 0
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE50284%27 HTTP/1.1" 200 None
2026-03-29 18:36:22 [auto1.de] INFO: Scrape type for LE50284: 2
2026-03-29 18:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284
2026-03-29 18:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe87daf-49e2-59be-8048-5ec13778aa9d with scrape type 2
2026-03-29 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe87daf-49e2-59be-8048-5ec13778aa9d with scrape type 2
2026-03-29 18:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fe87daf-49e2-59be-8048-5ec13778aa9d, identifier: LE50284
2026-03-29 18:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284
2026-03-29 18:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284
2026-03-29 18:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fe87daf-49e2-59be-8048-5ec13778aa9d with identifier: LE50284 to the API
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:41:59Z',
'fuel_type': 'petrol',
'id': '1fe87daf-49e2-59be-8048-5ec13778aa9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE50284',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 151326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'Ford Focus 1.8 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE50284%27 HTTP/1.1" 200 None
2026-03-29 18:36:22 [auto1.de] INFO: Saving data for LE50284: {'auction_closing_time': 1774885319.0, 'created_time': 1774118745.623213, 'last_price_update_time': 1774809382.92498}
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE50284') HTTP/1.1" 204 0
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-29 18:36:22 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN52751%27 HTTP/1.1" 200 None
2026-03-29 18:36:22 [auto1.de] INFO: Scrape type for FN52751: 2
2026-03-29 18:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751
2026-03-29 18:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 399e0cb9-41f0-56df-ba6a-a57707e30d66 with scrape type 2
2026-03-29 18:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 399e0cb9-41f0-56df-ba6a-a57707e30d66 with scrape type 2
2026-03-29 18:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 399e0cb9-41f0-56df-ba6a-a57707e30d66, identifier: FN52751
2026-03-29 18:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751
2026-03-29 18:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751
2026-03-29 18:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 399e0cb9-41f0-56df-ba6a-a57707e30d66 with identifier: FN52751 to the API
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:59:31Z',
'fuel_type': 'petrol',
'id': '399e0cb9-41f0-56df-ba6a-a57707e30d66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN52751',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 110732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-20',
'seller_name': None,
'title': 'Skoda Karoq 2.0 TSI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2019}
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN52751%27 HTTP/1.1" 200 None
2026-03-29 18:36:23 [auto1.de] INFO: Saving data for FN52751: {'auction_closing_time': 1774886371.0, 'created_time': 1773382558.343973, 'last_price_update_time': 1774809383.356006}
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN52751') HTTP/1.1" 204 0
2026-03-29 18:36:23 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-29 18:36:23 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC23766%27 HTTP/1.1" 200 None
2026-03-29 18:36:23 [auto1.de] INFO: Scrape type for SC23766: 2
2026-03-29 18:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766
2026-03-29 18:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with scrape type 2
2026-03-29 18:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with scrape type 2
2026-03-29 18:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b, identifier: SC23766
2026-03-29 18:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766
2026-03-29 18:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766
2026-03-29 18:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf2783f1-e1c3-583e-b9b9-6e94ca097f4b with identifier: SC23766 to the API
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:16:25Z',
'fuel_type': 'petrol',
'id': 'cf2783f1-e1c3-583e-b9b9-6e94ca097f4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC23766',
'listing': 'auction',
'make': 'BMW',
'model': 'X2',
'odometer': 54047,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-11',
'seller_name': None,
'title': 'BMW X2 sDrive 18i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC23766%27 HTTP/1.1" 200 None
2026-03-29 18:36:23 [auto1.de] INFO: Saving data for SC23766: {'auction_closing_time': 1774883785.0, 'created_time': 1774722953.960108, 'last_price_update_time': 1774809383.769356}
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC23766') HTTP/1.1" 204 0
2026-03-29 18:36:23 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL73395%27 HTTP/1.1" 200 None
2026-03-29 18:36:23 [auto1.de] INFO: Scrape type for CL73395: 2
2026-03-29 18:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395
2026-03-29 18:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f758f033-4219-53ef-97e1-7cc6a0f0cc02 with scrape type 2
2026-03-29 18:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f758f033-4219-53ef-97e1-7cc6a0f0cc02 with scrape type 2
2026-03-29 18:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f758f033-4219-53ef-97e1-7cc6a0f0cc02, identifier: CL73395
2026-03-29 18:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395
2026-03-29 18:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395
2026-03-29 18:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f758f033-4219-53ef-97e1-7cc6a0f0cc02 with identifier: CL73395 to the API
2026-03-29 18:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:48:23Z',
'fuel_type': 'petrol',
'id': 'f758f033-4219-53ef-97e1-7cc6a0f0cc02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL73395',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 164424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-28',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL73395%27 HTTP/1.1" 200 None
2026-03-29 18:36:24 [auto1.de] INFO: Saving data for CL73395: {'auction_closing_time': 1774885703.0, 'created_time': 1774034532.646449, 'last_price_update_time': 1774809384.164583}
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL73395') HTTP/1.1" 204 0
2026-03-29 18:36:24 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU96971%27 HTTP/1.1" 200 None
2026-03-29 18:36:24 [auto1.de] INFO: Scrape type for ZU96971: 2
2026-03-29 18:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971
2026-03-29 18:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f26f4a8-425d-554e-816e-9c1b50b5eafd with scrape type 2
2026-03-29 18:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f26f4a8-425d-554e-816e-9c1b50b5eafd with scrape type 2
2026-03-29 18:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f26f4a8-425d-554e-816e-9c1b50b5eafd, identifier: ZU96971
2026-03-29 18:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971
2026-03-29 18:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971
2026-03-29 18:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f26f4a8-425d-554e-816e-9c1b50b5eafd with identifier: ZU96971 to the API
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:59:42Z',
'fuel_type': 'petrol',
'id': '2f26f4a8-425d-554e-816e-9c1b50b5eafd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU96971',
'listing': 'auction',
'make': 'Peugeot',
'model': '206+',
'odometer': 97263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-21',
'seller_name': None,
'title': 'Peugeot 206+ 1.4 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2010}
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU96971%27 HTTP/1.1" 200 None
2026-03-29 18:36:24 [auto1.de] INFO: Saving data for ZU96971: {'auction_closing_time': 1774886382.0, 'created_time': 1773772530.714305, 'last_price_update_time': 1774809384.567917}
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU96971') HTTP/1.1" 204 0
2026-03-29 18:36:24 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-29 18:36:24 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-29 18:36:24 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-29 18:36:24 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP56300%27 HTTP/1.1" 200 None
2026-03-29 18:36:24 [auto1.de] INFO: Scrape type for FP56300: 2
2026-03-29 18:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300
2026-03-29 18:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24d74543-e32d-51b8-9311-d1eb79e2c796 with scrape type 2
2026-03-29 18:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24d74543-e32d-51b8-9311-d1eb79e2c796 with scrape type 2
2026-03-29 18:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24d74543-e32d-51b8-9311-d1eb79e2c796, identifier: FP56300
2026-03-29 18:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300
2026-03-29 18:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300
2026-03-29 18:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24d74543-e32d-51b8-9311-d1eb79e2c796 with identifier: FP56300 to the API
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:18Z',
'fuel_type': 'petrol',
'id': '24d74543-e32d-51b8-9311-d1eb79e2c796',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP56300',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 54960,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-14',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP56300%27 HTTP/1.1" 200 None
2026-03-29 18:36:24 [auto1.de] INFO: Saving data for FP56300: {'auction_closing_time': 1774884618.0, 'created_time': 1774034408.837887, 'last_price_update_time': 1774809384.96111}
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP56300') HTTP/1.1" 204 0
2026-03-29 18:36:25 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-29 18:36:25 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU56840%27 HTTP/1.1" 200 None
2026-03-29 18:36:25 [auto1.de] INFO: Scrape type for DU56840: 2
2026-03-29 18:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-03-29 18:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5d855a0-5ebb-55a0-b360-025ca21c840f with scrape type 2
2026-03-29 18:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5d855a0-5ebb-55a0-b360-025ca21c840f with scrape type 2
2026-03-29 18:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5d855a0-5ebb-55a0-b360-025ca21c840f, identifier: DU56840
2026-03-29 18:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-03-29 18:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840
2026-03-29 18:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5d855a0-5ebb-55a0-b360-025ca21c840f with identifier: DU56840 to the API
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:21:12Z',
'fuel_type': 'petrol',
'id': 'd5d855a0-5ebb-55a0-b360-025ca21c840f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU56840',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 80663,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-05',
'seller_name': None,
'title': 'Dacia Logan MCV 1.4 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2009}
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU56840%27 HTTP/1.1" 200 None
2026-03-29 18:36:25 [auto1.de] INFO: Saving data for DU56840: {'auction_closing_time': 1774884072.0, 'created_time': 1774722952.820784, 'last_price_update_time': 1774809385.455776}
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU56840') HTTP/1.1" 204 0
2026-03-29 18:36:25 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ42862%27 HTTP/1.1" 200 None
2026-03-29 18:36:25 [auto1.de] INFO: Scrape type for HJ42862: 2
2026-03-29 18:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862
2026-03-29 18:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49de2ea-4454-579e-a7eb-920e66b1cc41 with scrape type 2
2026-03-29 18:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e49de2ea-4454-579e-a7eb-920e66b1cc41 with scrape type 2
2026-03-29 18:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e49de2ea-4454-579e-a7eb-920e66b1cc41, identifier: HJ42862
2026-03-29 18:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862
2026-03-29 18:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862
2026-03-29 18:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e49de2ea-4454-579e-a7eb-920e66b1cc41 with identifier: HJ42862 to the API
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 354,
'expiration_date': '2026-03-30T15:36:55Z',
'fuel_type': 'petrol',
'id': 'e49de2ea-4454-579e-a7eb-920e66b1cc41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ42862',
'listing': 'auction',
'make': 'Audi',
'model': 'S5',
'odometer': 61872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-17',
'seller_name': None,
'title': 'Audi S5 3.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ42862%27 HTTP/1.1" 200 None
2026-03-29 18:36:25 [auto1.de] INFO: Saving data for HJ42862: {'auction_closing_time': 1774885015.0, 'created_time': 1774722961.527501, 'last_price_update_time': 1774809385.855935}
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ42862') HTTP/1.1" 204 0
2026-03-29 18:36:25 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-29 18:36:25 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-29 18:36:25 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC63257%27 HTTP/1.1" 200 None
2026-03-29 18:36:25 [auto1.de] INFO: Scrape type for NC63257: 2
2026-03-29 18:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257
2026-03-29 18:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 549018d2-e3fb-578f-9172-23f107888292 with scrape type 2
2026-03-29 18:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 549018d2-e3fb-578f-9172-23f107888292 with scrape type 2
2026-03-29 18:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 549018d2-e3fb-578f-9172-23f107888292, identifier: NC63257
2026-03-29 18:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257
2026-03-29 18:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257
2026-03-29 18:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 549018d2-e3fb-578f-9172-23f107888292 with identifier: NC63257 to the API
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:40:20Z',
'fuel_type': 'diesel',
'id': '549018d2-e3fb-578f-9172-23f107888292',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC63257',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 115619,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-28',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Shooting Brake 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2018}
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC63257%27 HTTP/1.1" 200 None
2026-03-29 18:36:26 [auto1.de] INFO: Saving data for NC63257: {'auction_closing_time': 1774885220.0, 'created_time': 1773429408.10556, 'last_price_update_time': 1774809386.27867}
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC63257') HTTP/1.1" 204 0
2026-03-29 18:36:26 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA49497%27 HTTP/1.1" 200 None
2026-03-29 18:36:26 [auto1.de] INFO: Scrape type for HA49497: 2
2026-03-29 18:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497
2026-03-29 18:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c976dc-1476-5398-9a48-5be093272f06 with scrape type 2
2026-03-29 18:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8c976dc-1476-5398-9a48-5be093272f06 with scrape type 2
2026-03-29 18:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8c976dc-1476-5398-9a48-5be093272f06, identifier: HA49497
2026-03-29 18:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497
2026-03-29 18:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497
2026-03-29 18:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8c976dc-1476-5398-9a48-5be093272f06 with identifier: HA49497 to the API
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:15:04Z',
'fuel_type': 'diesel',
'id': 'd8c976dc-1476-5398-9a48-5be093272f06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA49497',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 204379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-29',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Cosmo',
'transmission': 'automatic',
'trim': 'Cosmo',
'year': 2010}
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA49497%27 HTTP/1.1" 200 None
2026-03-29 18:36:26 [auto1.de] INFO: Saving data for HA49497: {'auction_closing_time': 1774883704.0, 'created_time': 1774722956.555698, 'last_price_update_time': 1774809386.679295}
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA49497') HTTP/1.1" 204 0
2026-03-29 18:36:26 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN25688%27 HTTP/1.1" 200 None
2026-03-29 18:36:26 [auto1.de] INFO: Scrape type for GN25688: 2
2026-03-29 18:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688
2026-03-29 18:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with scrape type 2
2026-03-29 18:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with scrape type 2
2026-03-29 18:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 942cc83e-f9e9-538f-8ff1-2d6e836d9882, identifier: GN25688
2026-03-29 18:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688
2026-03-29 18:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688
2026-03-29 18:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 942cc83e-f9e9-538f-8ff1-2d6e836d9882 with identifier: GN25688 to the API
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:30:36Z',
'fuel_type': 'diesel',
'id': '942cc83e-f9e9-538f-8ff1-2d6e836d9882',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN25688',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 170202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-19',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN25688%27 HTTP/1.1" 200 None
2026-03-29 18:36:27 [auto1.de] INFO: Saving data for GN25688: {'auction_closing_time': 1774884636.0, 'created_time': 1773400072.13368, 'last_price_update_time': 1774809387.093031}
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN25688') HTTP/1.1" 204 0
2026-03-29 18:36:27 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:27 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-29 18:36:27 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24294%27 HTTP/1.1" 200 None
2026-03-29 18:36:27 [auto1.de] INFO: Scrape type for SD24294: 2
2026-03-29 18:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294
2026-03-29 18:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bffffd0-6f0d-539f-aa13-d351800e4985 with scrape type 2
2026-03-29 18:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bffffd0-6f0d-539f-aa13-d351800e4985 with scrape type 2
2026-03-29 18:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bffffd0-6f0d-539f-aa13-d351800e4985, identifier: SD24294
2026-03-29 18:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294
2026-03-29 18:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294
2026-03-29 18:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bffffd0-6f0d-539f-aa13-d351800e4985 with identifier: SD24294 to the API
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:28:51Z',
'fuel_type': 'diesel',
'id': '1bffffd0-6f0d-539f-aa13-d351800e4985',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD24294',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 236683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-07',
'seller_name': None,
'title': 'BMW X1 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24294%27 HTTP/1.1" 200 None
2026-03-29 18:36:27 [auto1.de] INFO: Saving data for SD24294: {'auction_closing_time': 1774884531.0, 'created_time': 1774031791.775366, 'last_price_update_time': 1774809387.487276}
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD24294') HTTP/1.1" 204 0
2026-03-29 18:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:27 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY97697%27 HTTP/1.1" 200 None
2026-03-29 18:36:27 [auto1.de] INFO: Scrape type for JY97697: 2
2026-03-29 18:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697
2026-03-29 18:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817627b8-db25-52e5-994b-78ba13d1974a with scrape type 2
2026-03-29 18:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817627b8-db25-52e5-994b-78ba13d1974a with scrape type 2
2026-03-29 18:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817627b8-db25-52e5-994b-78ba13d1974a, identifier: JY97697
2026-03-29 18:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697
2026-03-29 18:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697
2026-03-29 18:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817627b8-db25-52e5-994b-78ba13d1974a with identifier: JY97697 to the API
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:39:23Z',
'fuel_type': 'diesel',
'id': '817627b8-db25-52e5-994b-78ba13d1974a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY97697',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 144984,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-12',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'manual',
'trim': 'RS',
'year': 2015}
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY97697%27 HTTP/1.1" 200 None
2026-03-29 18:36:27 [auto1.de] INFO: Saving data for JY97697: {'auction_closing_time': 1774885163.0, 'created_time': 1773381635.286719, 'last_price_update_time': 1774809387.913342}
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY97697') HTTP/1.1" 204 0
2026-03-29 18:36:28 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-29 18:36:28 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-29 18:36:28 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-29 18:36:28 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX79735%27 HTTP/1.1" 200 None
2026-03-29 18:36:28 [auto1.de] INFO: Scrape type for GX79735: 2
2026-03-29 18:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735
2026-03-29 18:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea302e3b-34bd-5242-9e59-95f59b14bfef with scrape type 2
2026-03-29 18:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea302e3b-34bd-5242-9e59-95f59b14bfef with scrape type 2
2026-03-29 18:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea302e3b-34bd-5242-9e59-95f59b14bfef, identifier: GX79735
2026-03-29 18:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735
2026-03-29 18:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735
2026-03-29 18:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea302e3b-34bd-5242-9e59-95f59b14bfef with identifier: GX79735 to the API
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:43:31Z',
'fuel_type': 'diesel',
'id': 'ea302e3b-34bd-5242-9e59-95f59b14bfef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX79735',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 167481,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-08',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX79735%27 HTTP/1.1" 200 None
2026-03-29 18:36:28 [auto1.de] INFO: Saving data for GX79735: {'auction_closing_time': 1774885411.0, 'created_time': 1774722958.996304, 'last_price_update_time': 1774809388.414972}
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX79735') HTTP/1.1" 204 0
2026-03-29 18:36:28 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY33636%27 HTTP/1.1" 200 None
2026-03-29 18:36:28 [auto1.de] INFO: Scrape type for ZY33636: 2
2026-03-29 18:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636
2026-03-29 18:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with scrape type 2
2026-03-29 18:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with scrape type 2
2026-03-29 18:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3, identifier: ZY33636
2026-03-29 18:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636
2026-03-29 18:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636
2026-03-29 18:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b412a89-49ac-58ea-9b0e-9718aee0dbd3 with identifier: ZY33636 to the API
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:21:58Z',
'fuel_type': 'petrol',
'id': '0b412a89-49ac-58ea-9b0e-9718aee0dbd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY33636',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra GTC',
'odometer': 197664,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-01',
'seller_name': None,
'title': 'Opel Astra GTC 1.4 Turbo Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2014}
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY33636%27 HTTP/1.1" 200 None
2026-03-29 18:36:28 [auto1.de] INFO: Saving data for ZY33636: {'auction_closing_time': 1774884118.0, 'created_time': 1773429460.695704, 'last_price_update_time': 1774809388.822283}
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY33636') HTTP/1.1" 204 0
2026-03-29 18:36:28 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-29 18:36:28 [auto1.de] INFO: Scrape type for HJ92241: 2
2026-03-29 18:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241
2026-03-29 18:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff7440ba-7118-5418-9225-70cde3da9d7f with scrape type 2
2026-03-29 18:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff7440ba-7118-5418-9225-70cde3da9d7f with scrape type 2
2026-03-29 18:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff7440ba-7118-5418-9225-70cde3da9d7f, identifier: HJ92241
2026-03-29 18:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241
2026-03-29 18:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 18:36:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241
2026-03-29 18:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff7440ba-7118-5418-9225-70cde3da9d7f with identifier: HJ92241 to the API
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:03:11Z',
'fuel_type': 'electro',
'id': 'ff7440ba-7118-5418-9225-70cde3da9d7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ92241',
'listing': 'auction',
'make': 'Toyota',
'model': 'bZ4X',
'odometer': 14203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-19',
'seller_name': None,
'title': 'Toyota bZ4X electric drive 150 kW FWD',
'transmission': 'automatic',
'trim': 'FWD',
'year': 2023}
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-29 18:36:29 [auto1.de] INFO: Saving data for HJ92241: {'auction_closing_time': 1774882991.0, 'created_time': 1774002945.156531, 'last_price_update_time': 1774809389.455361}
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ92241') HTTP/1.1" 204 0
2026-03-29 18:36:29 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-29 18:36:29 [auto1.de] INFO: Scrape type for FL18278: 2
2026-03-29 18:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278
2026-03-29 18:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b74853e1-e671-55e3-8f56-0f223bd311a9 with scrape type 2
2026-03-29 18:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b74853e1-e671-55e3-8f56-0f223bd311a9 with scrape type 2
2026-03-29 18:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b74853e1-e671-55e3-8f56-0f223bd311a9, identifier: FL18278
2026-03-29 18:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278
2026-03-29 18:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278
2026-03-29 18:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b74853e1-e671-55e3-8f56-0f223bd311a9 with identifier: FL18278 to the API
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:10:27Z',
'fuel_type': 'hybrid',
'id': 'b74853e1-e671-55e3-8f56-0f223bd311a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL18278',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 47365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-08',
'seller_name': None,
'title': 'Audi Q5 55 TFSIe quattro sport',
'transmission': 'automatic',
'trim': 'quattro sport',
'year': 2020}
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-29 18:36:29 [auto1.de] INFO: Saving data for FL18278: {'auction_closing_time': 1774883427.0, 'created_time': 1774032035.39741, 'last_price_update_time': 1774809389.875934}
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL18278') HTTP/1.1" 204 0
2026-03-29 18:36:29 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-29 18:36:29 [auto1.de] INFO: Scrape type for TE81012: 2
2026-03-29 18:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012
2026-03-29 18:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeeb9e31-55e1-57d7-97eb-65980871326d with scrape type 2
2026-03-29 18:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeeb9e31-55e1-57d7-97eb-65980871326d with scrape type 2
2026-03-29 18:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeeb9e31-55e1-57d7-97eb-65980871326d, identifier: TE81012
2026-03-29 18:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012
2026-03-29 18:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012
2026-03-29 18:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeeb9e31-55e1-57d7-97eb-65980871326d with identifier: TE81012 to the API
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:24:00Z',
'fuel_type': 'diesel',
'id': 'aeeb9e31-55e1-57d7-97eb-65980871326d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE81012',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 91736,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-05',
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2016}
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-29 18:36:30 [auto1.de] INFO: Saving data for TE81012: {'auction_closing_time': 1774884240.0, 'created_time': 1773382037.156294, 'last_price_update_time': 1774809390.27995}
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE81012') HTTP/1.1" 204 0
2026-03-29 18:36:30 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-29 18:36:30 [auto1.de] INFO: Scrape type for CG37224: 2
2026-03-29 18:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224
2026-03-29 18:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c511a35-2510-5bbb-99ca-5225a27979eb with scrape type 2
2026-03-29 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c511a35-2510-5bbb-99ca-5225a27979eb with scrape type 2
2026-03-29 18:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c511a35-2510-5bbb-99ca-5225a27979eb, identifier: CG37224
2026-03-29 18:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224
2026-03-29 18:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224
2026-03-29 18:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c511a35-2510-5bbb-99ca-5225a27979eb with identifier: CG37224 to the API
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:09:42Z',
'fuel_type': 'petrol',
'id': '6c511a35-2510-5bbb-99ca-5225a27979eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG37224',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 161977,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-22',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2008}
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-29 18:36:30 [auto1.de] INFO: Saving data for CG37224: {'auction_closing_time': 1774883382.0, 'created_time': 1773340844.041017, 'last_price_update_time': 1774809390.683339}
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG37224') HTTP/1.1" 204 0
2026-03-29 18:36:30 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-29 18:36:30 [auto1.de] INFO: Scrape type for BE55111: 2
2026-03-29 18:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111
2026-03-29 18:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with scrape type 2
2026-03-29 18:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with scrape type 2
2026-03-29 18:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f, identifier: BE55111
2026-03-29 18:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111
2026-03-29 18:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111
2026-03-29 18:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8d41f31-fbd5-5bc4-ada8-e31cdc15669f with identifier: BE55111 to the API
2026-03-29 18:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:43:38Z',
'fuel_type': 'petrol',
'id': 'e8d41f31-fbd5-5bc4-ada8-e31cdc15669f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE55111',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 128581,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-22',
'seller_name': None,
'title': 'Toyota Aygo 1.0 X',
'transmission': 'manual',
'trim': 'X',
'year': 2018}
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-29 18:36:32 [auto1.de] INFO: Saving data for BE55111: {'auction_closing_time': 1774885418.0, 'created_time': 1774722961.893238, 'last_price_update_time': 1774809392.095054}
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE55111') HTTP/1.1" 204 0
2026-03-29 18:36:32 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-29 18:36:32 [auto1.de] INFO: Scrape type for LV65947: 2
2026-03-29 18:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947
2026-03-29 18:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862c35f1-8815-55c8-855b-de5d1b2748fd with scrape type 2
2026-03-29 18:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 862c35f1-8815-55c8-855b-de5d1b2748fd with scrape type 2
2026-03-29 18:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 862c35f1-8815-55c8-855b-de5d1b2748fd, identifier: LV65947
2026-03-29 18:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947
2026-03-29 18:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947
2026-03-29 18:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 862c35f1-8815-55c8-855b-de5d1b2748fd with identifier: LV65947 to the API
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:42:00Z',
'fuel_type': 'hybrid',
'id': '862c35f1-8815-55c8-855b-de5d1b2748fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV65947',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 33907,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-02',
'seller_name': None,
'title': 'Kia Sportage 1.6 Plug-in Hybrid GT-Line 4WD',
'transmission': 'automatic',
'trim': 'GT-Line 4WD',
'year': 2022}
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-29 18:36:32 [auto1.de] INFO: Saving data for LV65947: {'auction_closing_time': 1774885320.0, 'created_time': 1773399838.304547, 'last_price_update_time': 1774809392.539283}
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV65947') HTTP/1.1" 204 0
2026-03-29 18:36:32 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-29 18:36:32 [auto1.de] INFO: Scrape type for VN71215: 2
2026-03-29 18:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215
2026-03-29 18:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc79706-32da-5093-9d13-7cd6accb8992 with scrape type 2
2026-03-29 18:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbc79706-32da-5093-9d13-7cd6accb8992 with scrape type 2
2026-03-29 18:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbc79706-32da-5093-9d13-7cd6accb8992, identifier: VN71215
2026-03-29 18:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215
2026-03-29 18:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215
2026-03-29 18:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbc79706-32da-5093-9d13-7cd6accb8992 with identifier: VN71215 to the API
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:01:04Z',
'fuel_type': 'petrol',
'id': 'fbc79706-32da-5093-9d13-7cd6accb8992',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN71215',
'listing': 'auction',
'make': 'Opel',
'model': 'Vectra',
'odometer': 137317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-21',
'seller_name': None,
'title': 'Opel Vectra 1.8 GTS',
'transmission': 'manual',
'trim': 'GTS',
'year': 2003}
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-29 18:36:33 [auto1.de] INFO: Saving data for VN71215: {'auction_closing_time': 1774882864.0, 'created_time': 1773428790.228689, 'last_price_update_time': 1774809393.097143}
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN71215') HTTP/1.1" 204 0
2026-03-29 18:36:33 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57331%27 HTTP/1.1" 200 None
2026-03-29 18:36:33 [auto1.de] INFO: Scrape type for FY57331: 2
2026-03-29 18:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331
2026-03-29 18:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d237a50-1c88-5565-a2a7-c77a816988be with scrape type 2
2026-03-29 18:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d237a50-1c88-5565-a2a7-c77a816988be with scrape type 2
2026-03-29 18:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d237a50-1c88-5565-a2a7-c77a816988be, identifier: FY57331
2026-03-29 18:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331
2026-03-29 18:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331
2026-03-29 18:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d237a50-1c88-5565-a2a7-c77a816988be with identifier: FY57331 to the API
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:29:39Z',
'fuel_type': 'petrol',
'id': '6d237a50-1c88-5565-a2a7-c77a816988be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY57331',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 334384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-29',
'seller_name': None,
'title': 'Ford Focus 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2008}
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57331%27 HTTP/1.1" 200 None
2026-03-29 18:36:33 [auto1.de] INFO: Saving data for FY57331: {'auction_closing_time': 1774884579.0, 'created_time': 1774722964.40495, 'last_price_update_time': 1774809393.505692}
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY57331') HTTP/1.1" 204 0
2026-03-29 18:36:33 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS42870%27 HTTP/1.1" 200 None
2026-03-29 18:36:33 [auto1.de] INFO: Scrape type for GS42870: 2
2026-03-29 18:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870
2026-03-29 18:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13389882-0c83-535c-8d4a-4064cc5649f7 with scrape type 2
2026-03-29 18:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13389882-0c83-535c-8d4a-4064cc5649f7 with scrape type 2
2026-03-29 18:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13389882-0c83-535c-8d4a-4064cc5649f7, identifier: GS42870
2026-03-29 18:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870
2026-03-29 18:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870
2026-03-29 18:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13389882-0c83-535c-8d4a-4064cc5649f7 with identifier: GS42870 to the API
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:21:36Z',
'fuel_type': 'petrol',
'id': '13389882-0c83-535c-8d4a-4064cc5649f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS42870',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 117861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-24',
'seller_name': None,
'title': 'Porsche Macan 2.0',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS42870%27 HTTP/1.1" 200 None
2026-03-29 18:36:33 [auto1.de] INFO: Saving data for GS42870: {'auction_closing_time': 1774884096.0, 'created_time': 1774350279.961746, 'last_price_update_time': 1774809393.919871}
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS42870') HTTP/1.1" 204 0
2026-03-29 18:36:33 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:33 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT54263%27 HTTP/1.1" 200 None
2026-03-29 18:36:33 [auto1.de] INFO: Scrape type for MT54263: 2
2026-03-29 18:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263
2026-03-29 18:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171d7b08-9311-5335-9a4f-9c7831d449a3 with scrape type 2
2026-03-29 18:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171d7b08-9311-5335-9a4f-9c7831d449a3 with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 171d7b08-9311-5335-9a4f-9c7831d449a3, identifier: MT54263
2026-03-29 18:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263
2026-03-29 18:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263
2026-03-29 18:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 171d7b08-9311-5335-9a4f-9c7831d449a3 with identifier: MT54263 to the API
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:01:32Z',
'fuel_type': 'diesel',
'id': '171d7b08-9311-5335-9a4f-9c7831d449a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT54263',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 92147,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-26',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2007}
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT54263%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Saving data for MT54263: {'auction_closing_time': 1774882892.0, 'created_time': 1774032333.920533, 'last_price_update_time': 1774809394.377075}
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT54263') HTTP/1.1" 204 0
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM46839%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Scrape type for ZM46839: 2
2026-03-29 18:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839
2026-03-29 18:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1531b90c-f1a4-5bdf-aa51-4069f39212fd with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1531b90c-f1a4-5bdf-aa51-4069f39212fd with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1531b90c-f1a4-5bdf-aa51-4069f39212fd, identifier: ZM46839
2026-03-29 18:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-29 18:36:34 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49081%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Scrape type for ZZ49081: 2
2026-03-29 18:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081
2026-03-29 18:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f70411d8-ecbe-5110-8d85-119499307c66 with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f70411d8-ecbe-5110-8d85-119499307c66 with scrape type 2
2026-03-29 18:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f70411d8-ecbe-5110-8d85-119499307c66, identifier: ZZ49081
2026-03-29 18:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839
2026-03-29 18:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839
2026-03-29 18:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1531b90c-f1a4-5bdf-aa51-4069f39212fd with identifier: ZM46839 to the API
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:41Z',
'fuel_type': 'diesel',
'id': '1531b90c-f1a4-5bdf-aa51-4069f39212fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM46839',
'listing': 'auction',
'make': 'Audi',
'model': 'A3',
'odometer': 240988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-04',
'seller_name': None,
'title': 'Audi A3 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2013}
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM46839%27 HTTP/1.1" 200 None
2026-03-29 18:36:34 [auto1.de] INFO: Saving data for ZM46839: {'auction_closing_time': 1774883201.0, 'created_time': 1773427688.417628, 'last_price_update_time': 1774809394.926785}
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM46839') HTTP/1.1" 204 0
2026-03-29 18:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081
2026-03-29 18:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081
2026-03-29 18:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f70411d8-ecbe-5110-8d85-119499307c66 with identifier: ZZ49081 to the API
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:26:25Z',
'fuel_type': 'petrol',
'id': 'f70411d8-ecbe-5110-8d85-119499307c66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ49081',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 86286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-04',
'seller_name': None,
'title': 'Hyundai i30 1.0 TGDI Select',
'transmission': 'manual',
'trim': 'Select',
'year': 2018}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49081%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Saving data for ZZ49081: {'auction_closing_time': 1774884385.0, 'created_time': 1774350660.334283, 'last_price_update_time': 1774809395.225851}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ49081') HTTP/1.1" 204 0
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL16151%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Scrape type for PL16151: 2
2026-03-29 18:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151
2026-03-29 18:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb54893d-3b8b-5cf8-b3c2-799c8944a550 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb54893d-3b8b-5cf8-b3c2-799c8944a550 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb54893d-3b8b-5cf8-b3c2-799c8944a550, identifier: PL16151
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Scrape type for GY35476: 0
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-29 18:36:35 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB49809%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Scrape type for GB49809: 2
2026-03-29 18:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809
2026-03-29 18:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85bd1837-1010-5eb8-a287-61670badb2b4 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85bd1837-1010-5eb8-a287-61670badb2b4 with scrape type 2
2026-03-29 18:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85bd1837-1010-5eb8-a287-61670badb2b4, identifier: GB49809
2026-03-29 18:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151
2026-03-29 18:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151
2026-03-29 18:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb54893d-3b8b-5cf8-b3c2-799c8944a550 with identifier: PL16151 to the API
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:50:46Z',
'fuel_type': 'diesel',
'id': 'bb54893d-3b8b-5cf8-b3c2-799c8944a550',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL16151',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 247052,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-05',
'seller_name': None,
'title': 'BMW 5er 535d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL16151%27 HTTP/1.1" 200 None
2026-03-29 18:36:35 [auto1.de] INFO: Saving data for PL16151: {'auction_closing_time': 1774885846.0, 'created_time': 1774722963.04941, 'last_price_update_time': 1774809395.732278}
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL16151') HTTP/1.1" 204 0
2026-03-29 18:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 18:36:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809
2026-03-29 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85bd1837-1010-5eb8-a287-61670badb2b4 with identifier: GB49809 to the API
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:56:28Z',
'fuel_type': 'diesel',
'id': '85bd1837-1010-5eb8-a287-61670badb2b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB49809',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 81218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-05',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L1 Tourneo Titanium X',
'transmission': 'manual',
'trim': '320 L1 Tourneo Titanium X',
'year': 2021}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB49809%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Saving data for GB49809: {'auction_closing_time': 1774886188.0, 'created_time': 1774722962.388067, 'last_price_update_time': 1774809396.294924}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB49809') HTTP/1.1" 204 0
2026-03-29 18:36:36 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT44390%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Scrape type for GT44390: 2
2026-03-29 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390
2026-03-29 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0acbd2-9ac5-571c-a50b-786cfecea682 with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0acbd2-9ac5-571c-a50b-786cfecea682 with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe0acbd2-9ac5-571c-a50b-786cfecea682, identifier: GT44390
2026-03-29 18:36:36 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT85175%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Scrape type for LT85175: 2
2026-03-29 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175
2026-03-29 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with scrape type 2
2026-03-29 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd6f1c8c-cee5-5659-828f-7dc4be9827a2, identifier: LT85175
2026-03-29 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390
2026-03-29 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390
2026-03-29 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe0acbd2-9ac5-571c-a50b-786cfecea682 with identifier: GT44390 to the API
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:24:47Z',
'fuel_type': 'petrol',
'id': 'fe0acbd2-9ac5-571c-a50b-786cfecea682',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT44390',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 160042,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'Skoda Yeti 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT44390%27 HTTP/1.1" 200 None
2026-03-29 18:36:36 [auto1.de] INFO: Saving data for GT44390: {'auction_closing_time': 1774884287.0, 'created_time': 1774034124.843856, 'last_price_update_time': 1774809396.788405}
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT44390') HTTP/1.1" 204 0
2026-03-29 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175
2026-03-29 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175
2026-03-29 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd6f1c8c-cee5-5659-828f-7dc4be9827a2 with identifier: LT85175 to the API
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:02:14Z',
'fuel_type': 'petrol',
'id': 'dd6f1c8c-cee5-5659-828f-7dc4be9827a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT85175',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 62229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-13',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Celebration',
'transmission': 'manual',
'trim': 'Stepway Celebration',
'year': 2017}
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT85175%27 HTTP/1.1" 200 None
2026-03-29 18:36:37 [auto1.de] INFO: Saving data for LT85175: {'auction_closing_time': 1774882934.0, 'created_time': 1774722965.120889, 'last_price_update_time': 1774809397.096684}
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT85175') HTTP/1.1" 204 0
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK02034%27 HTTP/1.1" 200 None
2026-03-29 18:36:37 [auto1.de] INFO: Scrape type for NK02034: 2
2026-03-29 18:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034
2026-03-29 18:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd45248-0eb1-585f-b373-0dcbda18287c with scrape type 2
2026-03-29 18:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd45248-0eb1-585f-b373-0dcbda18287c with scrape type 2
2026-03-29 18:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dd45248-0eb1-585f-b373-0dcbda18287c, identifier: NK02034
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-29 18:36:37 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX33649%27 HTTP/1.1" 200 None
2026-03-29 18:36:37 [auto1.de] INFO: Scrape type for LX33649: 2
2026-03-29 18:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649
2026-03-29 18:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebf0469-2886-5b42-a16c-21e4f83773f6 with scrape type 2
2026-03-29 18:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ebf0469-2886-5b42-a16c-21e4f83773f6 with scrape type 2
2026-03-29 18:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ebf0469-2886-5b42-a16c-21e4f83773f6, identifier: LX33649
2026-03-29 18:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034
2026-03-29 18:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034
2026-03-29 18:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dd45248-0eb1-585f-b373-0dcbda18287c with identifier: NK02034 to the API
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:24:59Z',
'fuel_type': 'petrol',
'id': '4dd45248-0eb1-585f-b373-0dcbda18287c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK02034',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 169143,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-28',
'seller_name': None,
'title': 'Opel Corsa 1.2 CMon',
'transmission': 'manual',
'trim': 'CMon',
'year': 2011}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK02034%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Saving data for NK02034: {'auction_closing_time': 1774884299.0, 'created_time': 1773383490.424292, 'last_price_update_time': 1774809398.100959}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK02034') HTTP/1.1" 204 0
2026-03-29 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649
2026-03-29 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649
2026-03-29 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ebf0469-2886-5b42-a16c-21e4f83773f6 with identifier: LX33649 to the API
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:27:26Z',
'fuel_type': 'diesel',
'id': '1ebf0469-2886-5b42-a16c-21e4f83773f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX33649',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 131192,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-27',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2017}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX33649%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Saving data for LX33649: {'auction_closing_time': 1774884446.0, 'created_time': 1773428967.09504, 'last_price_update_time': 1774809398.405522}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX33649') HTTP/1.1" 204 0
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Scrape type for PN39432: 2
2026-03-29 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432
2026-03-29 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 049652ce-7d88-5dbc-91d8-1533ca0a1a59, identifier: PN39432
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-29 18:36:38 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT69326%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Scrape type for NT69326: 2
2026-03-29 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326
2026-03-29 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626821e8-7f03-523c-9d58-0275f5fd691a with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626821e8-7f03-523c-9d58-0275f5fd691a with scrape type 2
2026-03-29 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 626821e8-7f03-523c-9d58-0275f5fd691a, identifier: NT69326
2026-03-29 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432
2026-03-29 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432
2026-03-29 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 049652ce-7d88-5dbc-91d8-1533ca0a1a59 with identifier: PN39432 to the API
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:42:07Z',
'fuel_type': 'petrol',
'id': '049652ce-7d88-5dbc-91d8-1533ca0a1a59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN39432',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 98356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-03',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2017}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-29 18:36:38 [auto1.de] INFO: Saving data for PN39432: {'auction_closing_time': 1774885327.0, 'created_time': 1774034618.296253, 'last_price_update_time': 1774809398.966273}
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN39432') HTTP/1.1" 204 0
2026-03-29 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326
2026-03-29 18:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326
2026-03-29 18:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 626821e8-7f03-523c-9d58-0275f5fd691a with identifier: NT69326 to the API
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:43:59Z',
'fuel_type': 'diesel',
'id': '626821e8-7f03-523c-9d58-0275f5fd691a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT69326',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 233694,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-11',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2012}
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT69326%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Saving data for NT69326: {'auction_closing_time': 1774885439.0, 'created_time': 1773429293.462461, 'last_price_update_time': 1774809399.351162}
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT69326') HTTP/1.1" 204 0
2026-03-29 18:36:39 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Scrape type for XB31619: 2
2026-03-29 18:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619
2026-03-29 18:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac8b67f3-82be-5fff-a8e8-17f57bef89e9, identifier: XB31619
2026-03-29 18:36:39 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP45750%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Scrape type for MP45750: 2
2026-03-29 18:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750
2026-03-29 18:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f91507fb-f0d5-568e-8433-fc259e6af072 with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f91507fb-f0d5-568e-8433-fc259e6af072 with scrape type 2
2026-03-29 18:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f91507fb-f0d5-568e-8433-fc259e6af072, identifier: MP45750
2026-03-29 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619
2026-03-29 18:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619
2026-03-29 18:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac8b67f3-82be-5fff-a8e8-17f57bef89e9 with identifier: XB31619 to the API
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:25Z',
'fuel_type': 'petrol',
'id': 'ac8b67f3-82be-5fff-a8e8-17f57bef89e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB31619',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 91246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-14',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
'transmission': 'manual',
'trim': 'United',
'year': 2021}
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-29 18:36:39 [auto1.de] INFO: Saving data for XB31619: {'auction_closing_time': 1774883605.0, 'created_time': 1774722966.799481, 'last_price_update_time': 1774809399.895817}
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB31619') HTTP/1.1" 204 0
2026-03-29 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 18:36:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750
2026-03-29 18:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f91507fb-f0d5-568e-8433-fc259e6af072 with identifier: MP45750 to the API
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:49:35Z',
'fuel_type': 'petrol',
'id': 'f91507fb-f0d5-568e-8433-fc259e6af072',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP45750',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 27973,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-06',
'seller_name': None,
'title': 'Renault Twingo 1.2 Paris',
'transmission': 'automatic',
'trim': 'Paris',
'year': 2014}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP45750%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Saving data for MP45750: {'auction_closing_time': 1774885775.0, 'created_time': 1773340884.387861, 'last_price_update_time': 1774809400.340982}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP45750') HTTP/1.1" 204 0
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55481%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Scrape type for YA55481: 2
2026-03-29 18:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481
2026-03-29 18:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94dfbddb-8b40-546d-8854-2933966e0e42 with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94dfbddb-8b40-546d-8854-2933966e0e42 with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94dfbddb-8b40-546d-8854-2933966e0e42, identifier: YA55481
2026-03-29 18:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:40 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14329%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Scrape type for BS14329: 2
2026-03-29 18:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329
2026-03-29 18:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7465cf5-92ab-5735-8743-b6796b6fe637 with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7465cf5-92ab-5735-8743-b6796b6fe637 with scrape type 2
2026-03-29 18:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7465cf5-92ab-5735-8743-b6796b6fe637, identifier: BS14329
2026-03-29 18:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481
2026-03-29 18:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481
2026-03-29 18:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94dfbddb-8b40-546d-8854-2933966e0e42 with identifier: YA55481 to the API
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:44:20Z',
'fuel_type': 'petrol',
'id': '94dfbddb-8b40-546d-8854-2933966e0e42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA55481',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 297206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2010}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55481%27 HTTP/1.1" 200 None
2026-03-29 18:36:40 [auto1.de] INFO: Saving data for YA55481: {'auction_closing_time': 1774885460.0, 'created_time': 1774350077.535373, 'last_price_update_time': 1774809400.863065}
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA55481') HTTP/1.1" 204 0
2026-03-29 18:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329
2026-03-29 18:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329
2026-03-29 18:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7465cf5-92ab-5735-8743-b6796b6fe637 with identifier: BS14329 to the API
2026-03-29 18:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:08:24Z',
'fuel_type': 'petrol',
'id': 'a7465cf5-92ab-5735-8743-b6796b6fe637',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS14329',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 142377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-26',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 360',
'transmission': 'manual',
'trim': '360',
'year': 2013}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14329%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Saving data for BS14329: {'auction_closing_time': 1774883304.0, 'created_time': 1773340994.233248, 'last_price_update_time': 1774809401.196694}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS14329') HTTP/1.1" 204 0
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP30050%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for EP30050: 0
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for GX41654: 2
2026-03-29 18:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654
2026-03-29 18:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0e3c4c-9df7-5962-8d7f-37961f94179d with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0e3c4c-9df7-5962-8d7f-37961f94179d with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b0e3c4c-9df7-5962-8d7f-37961f94179d, identifier: GX41654
2026-03-29 18:36:41 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW62804%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Scrape type for HW62804: 2
2026-03-29 18:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804
2026-03-29 18:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d3241c-15c5-576e-8e4a-31edabb1538d with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9d3241c-15c5-576e-8e4a-31edabb1538d with scrape type 2
2026-03-29 18:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9d3241c-15c5-576e-8e4a-31edabb1538d, identifier: HW62804
2026-03-29 18:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654
2026-03-29 18:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654
2026-03-29 18:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b0e3c4c-9df7-5962-8d7f-37961f94179d with identifier: GX41654 to the API
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:32:02Z',
'fuel_type': 'diesel',
'id': '3b0e3c4c-9df7-5962-8d7f-37961f94179d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX41654',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 250024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-29',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2011}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-29 18:36:41 [auto1.de] INFO: Saving data for GX41654: {'auction_closing_time': 1774884722.0, 'created_time': 1774350537.063586, 'last_price_update_time': 1774809401.797287}
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX41654') HTTP/1.1" 204 0
2026-03-29 18:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804
2026-03-29 18:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804
2026-03-29 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9d3241c-15c5-576e-8e4a-31edabb1538d with identifier: HW62804 to the API
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 260,
'expiration_date': '2026-03-30T15:51:50Z',
'fuel_type': 'petrol',
'id': 'c9d3241c-15c5-576e-8e4a-31edabb1538d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW62804',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Grand Sport',
'odometer': 121968,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-27',
'seller_name': None,
'title': 'Opel Insignia Grand Sport 2.0 SIDI Turbo Innovation 4x4',
'transmission': 'automatic',
'trim': 'Innovation 4x4',
'year': 2017}
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW62804%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Saving data for HW62804: {'auction_closing_time': 1774885910.0, 'created_time': 1773340891.730652, 'last_price_update_time': 1774809402.253087}
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW62804') HTTP/1.1" 204 0
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Scrape type for LW18163: 2
2026-03-29 18:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-29 18:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1497bf16-a845-59af-8797-a627a7d61672 with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1497bf16-a845-59af-8797-a627a7d61672 with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1497bf16-a845-59af-8797-a627a7d61672, identifier: LW18163
2026-03-29 18:36:42 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS91998%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Scrape type for BS91998: 2
2026-03-29 18:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998
2026-03-29 18:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with scrape type 2
2026-03-29 18:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e, identifier: BS91998
2026-03-29 18:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-29 18:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-29 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163 to the API
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:00:28Z',
'fuel_type': 'diesel',
'id': '1497bf16-a845-59af-8797-a627a7d61672',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW18163',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60',
'odometer': 206605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-07',
'seller_name': None,
'title': 'Volvo V60 2.0 D4 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2013}
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-29 18:36:42 [auto1.de] INFO: Saving data for LW18163: {'auction_closing_time': 1774882828.0, 'created_time': 1774607870.080896, 'last_price_update_time': 1774809402.816508}
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW18163') HTTP/1.1" 204 0
2026-03-29 18:36:42 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998
2026-03-29 18:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998
2026-03-29 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e with identifier: BS91998 to the API
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:08:54Z',
'fuel_type': 'diesel',
'id': '221b7c2a-499d-5b3b-a4a8-d118d9d7bd9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS91998',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 85922,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-27',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
'transmission': 'manual',
'trim': 'Rapid Extra',
'year': 2015}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS91998%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Saving data for BS91998: {'auction_closing_time': 1774883334.0, 'created_time': 1774722964.012114, 'last_price_update_time': 1774809403.115322}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS91998') HTTP/1.1" 204 0
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for TG96584: 2
2026-03-29 18:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-29 18:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4, identifier: TG96584
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27591%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for WW27591: 2
2026-03-29 18:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591
2026-03-29 18:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c36433ab-49ac-52d3-9323-471b0b694f8c with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c36433ab-49ac-52d3-9323-471b0b694f8c with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c36433ab-49ac-52d3-9323-471b0b694f8c, identifier: WW27591
2026-03-29 18:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-29 18:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-29 18:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584 to the API
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:13:10Z',
'fuel_type': 'diesel',
'id': '7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG96584',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 82638,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-09',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 160 CDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Saving data for TG96584: {'auction_closing_time': 1774883590.0, 'created_time': 1774608351.072797, 'last_price_update_time': 1774809403.671885}
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG96584') HTTP/1.1" 204 0
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM92730%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for PM92730: 0
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35466%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for RD35466: 0
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-29 18:36:43 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-29 18:36:43 [auto1.de] INFO: Scrape type for SK60410: 2
2026-03-29 18:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-29 18:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddee70d-734a-5a90-beda-406fde31c029 with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dddee70d-734a-5a90-beda-406fde31c029 with scrape type 2
2026-03-29 18:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dddee70d-734a-5a90-beda-406fde31c029, identifier: SK60410
2026-03-29 18:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591
2026-03-29 18:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591
2026-03-29 18:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c36433ab-49ac-52d3-9323-471b0b694f8c with identifier: WW27591 to the API
2026-03-29 18:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:27:59Z',
'fuel_type': 'petrol',
'id': 'c36433ab-49ac-52d3-9323-471b0b694f8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW27591',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 130812,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-03-18',
'seller_name': None,
'title': 'Volvo V40 1.9 T4',
'transmission': 'automatic',
'trim': '',
'year': 1999}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27591%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Saving data for WW27591: {'auction_closing_time': 1774884479.0, 'created_time': 1773382220.11877, 'last_price_update_time': 1774809404.145686}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW27591') HTTP/1.1" 204 0
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Scrape type for RC23376: 0
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM86036%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Scrape type for BM86036: 2
2026-03-29 18:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036
2026-03-29 18:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f0a3241-28e0-5e4a-b772-253395a1f1db with scrape type 2
2026-03-29 18:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f0a3241-28e0-5e4a-b772-253395a1f1db with scrape type 2
2026-03-29 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f0a3241-28e0-5e4a-b772-253395a1f1db, identifier: BM86036
2026-03-29 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-29 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-29 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410 to the API
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:19:42Z',
'fuel_type': 'diesel',
'id': 'dddee70d-734a-5a90-beda-406fde31c029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK60410',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 205170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-01',
'seller_name': None,
'title': 'BMW 5er 525d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-29 18:36:44 [auto1.de] INFO: Saving data for SK60410: {'auction_closing_time': 1774883982.0, 'created_time': 1774608668.356028, 'last_price_update_time': 1774809404.729088}
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK60410') HTTP/1.1" 204 0
2026-03-29 18:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:44 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-29 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036
2026-03-29 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036
2026-03-29 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f0a3241-28e0-5e4a-b772-253395a1f1db with identifier: BM86036 to the API
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 84,
'expiration_date': '2026-03-30T15:52:08Z',
'fuel_type': 'petrol',
'id': '3f0a3241-28e0-5e4a-b772-253395a1f1db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM86036',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 8279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-06',
'seller_name': None,
'title': 'Kia Picanto 1.2 GT Line',
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2024}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM86036%27 HTTP/1.1" 200 None
2026-03-29 18:36:45 [auto1.de] INFO: Saving data for BM86036: {'auction_closing_time': 1774885928.0, 'created_time': 1773426941.464583, 'last_price_update_time': 1774809405.045884}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM86036') HTTP/1.1" 204 0
2026-03-29 18:36:45 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-29 18:36:45 [auto1.de] INFO: Scrape type for TS01373: 2
2026-03-29 18:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-29 18:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe319b1-9968-5a96-9201-ef26ae508395 with scrape type 2
2026-03-29 18:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe319b1-9968-5a96-9201-ef26ae508395 with scrape type 2
2026-03-29 18:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fe319b1-9968-5a96-9201-ef26ae508395, identifier: TS01373
2026-03-29 18:36:45 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-29 18:36:45 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-29 18:36:45 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-29 18:36:45 [auto1.de] INFO: Scrape type for BP45840: 2
2026-03-29 18:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-29 18:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac7daf9-4f1f-581d-9946-7adb467dc4e5 with scrape type 2
2026-03-29 18:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac7daf9-4f1f-581d-9946-7adb467dc4e5 with scrape type 2
2026-03-29 18:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cac7daf9-4f1f-581d-9946-7adb467dc4e5, identifier: BP45840
2026-03-29 18:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-29 18:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-29 18:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373 to the API
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:28:13Z',
'fuel_type': 'petrol',
'id': '5fe319b1-9968-5a96-9201-ef26ae508395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS01373',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 70434,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-01',
'seller_name': None,
'title': 'MINI Countryman Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-29 18:36:45 [auto1.de] INFO: Saving data for TS01373: {'auction_closing_time': 1774884493.0, 'created_time': 1774607769.045483, 'last_price_update_time': 1774809405.636165}
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS01373') HTTP/1.1" 204 0
2026-03-29 18:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-29 18:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-29 18:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840 to the API
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:05:14Z',
'fuel_type': 'petrol',
'id': 'cac7daf9-4f1f-581d-9946-7adb467dc4e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP45840',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 161583,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-16',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2019}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Saving data for BP45840: {'auction_closing_time': 1774883114.0, 'created_time': 1773304994.395862, 'last_price_update_time': 1774809406.111781}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP45840') HTTP/1.1" 204 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for ST88871: 0
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for KH96137: 2
2026-03-29 18:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-29 18:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee910bd-65a1-582f-bd5e-7f6162d01902 with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ee910bd-65a1-582f-bd5e-7f6162d01902 with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ee910bd-65a1-582f-bd5e-7f6162d01902, identifier: KH96137
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-29 18:36:46 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Scrape type for FL79995: 2
2026-03-29 18:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-29 18:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 753e7f57-036c-5a75-a3ea-bf48be584fc4 with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 753e7f57-036c-5a75-a3ea-bf48be584fc4 with scrape type 2
2026-03-29 18:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 753e7f57-036c-5a75-a3ea-bf48be584fc4, identifier: FL79995
2026-03-29 18:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-29 18:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-29 18:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137 to the API
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:44:14Z',
'fuel_type': 'diesel',
'id': '7ee910bd-65a1-582f-bd5e-7f6162d01902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH96137',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 224096,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-24',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi 360',
'transmission': 'automatic',
'trim': '360',
'year': 2015}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Saving data for KH96137: {'auction_closing_time': 1774885454.0, 'created_time': 1773830580.958743, 'last_price_update_time': 1774809406.703569}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH96137') HTTP/1.1" 204 0
2026-03-29 18:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-29 18:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995
2026-03-29 18:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 753e7f57-036c-5a75-a3ea-bf48be584fc4 with identifier: FL79995 to the API
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:34:44Z',
'fuel_type': 'petrol',
'id': '753e7f57-036c-5a75-a3ea-bf48be584fc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL79995',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 64809,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-12',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CGI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-29 18:36:46 [auto1.de] INFO: Saving data for FL79995: {'auction_closing_time': 1774884884.0, 'created_time': 1774522509.1848, 'last_price_update_time': 1774809406.992482}
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL79995') HTTP/1.1" 204 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for FH64312: 2
2026-03-29 18:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-29 18:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9e61d35-35b1-593f-94ad-78ad9d1aaa23, identifier: FH64312
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA63852%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for FA63852: 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-29 18:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-29 18:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-29 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312 to the API
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:01:13Z',
'fuel_type': 'diesel',
'id': 'e9e61d35-35b1-593f-94ad-78ad9d1aaa23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH64312',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 191028,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-25',
'seller_name': None,
'title': 'BMW 5er 525d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2012}
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Saving data for FH64312: {'auction_closing_time': 1774882873.0, 'created_time': 1773305674.986573, 'last_price_update_time': 1774809407.494893}
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH64312') HTTP/1.1" 204 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for BE37865: 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for VX41895: 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for GV12841: 0
2026-03-29 18:36:47 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-29 18:36:47 [auto1.de] INFO: Scrape type for HN51683: 2
2026-03-29 18:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-29 18:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef40ab49-c4ee-54d1-b189-3b30df34a458 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef40ab49-c4ee-54d1-b189-3b30df34a458 with scrape type 2
2026-03-29 18:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef40ab49-c4ee-54d1-b189-3b30df34a458, identifier: HN51683
2026-03-29 18:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-29 18:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-29 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683 to the API
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:07:46Z',
'fuel_type': 'petrol',
'id': 'ef40ab49-c4ee-54d1-b189-3b30df34a458',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN51683',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 95167,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-26',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2013}
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-29 18:36:48 [auto1.de] INFO: Saving data for HN51683: {'auction_closing_time': 1774883266.0, 'created_time': 1774034602.752146, 'last_price_update_time': 1774809408.041518}
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN51683') HTTP/1.1" 204 0
2026-03-29 18:36:48 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-29 18:36:48 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-29 18:36:48 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP71706%27 HTTP/1.1" 200 None
2026-03-29 18:36:48 [auto1.de] INFO: Scrape type for FP71706: 0
2026-03-29 18:36:48 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-29 18:36:48 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-29 18:36:48 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-29 18:36:48 [auto1.de] INFO: Scrape type for ML63417: 2
2026-03-29 18:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-29 18:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with scrape type 2
2026-03-29 18:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with scrape type 2
2026-03-29 18:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c48f9e-1c72-5d99-bca9-2c24a87ff617, identifier: ML63417
2026-03-29 18:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-29 18:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-29 18:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417 to the API
2026-03-29 18:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:17:06Z',
'fuel_type': 'diesel',
'id': 'c8c48f9e-1c72-5d99-bca9-2c24a87ff617',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML63417',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 183024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-20',
'seller_name': None,
'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Trend Edition',
'transmission': 'automatic',
'trim': 'kompakt BlueEfficiency Trend Edition',
'year': 2011}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Saving data for ML63417: {'auction_closing_time': 1774883826.0, 'created_time': 1774607772.857587, 'last_price_update_time': 1774809409.132701}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML63417') HTTP/1.1" 204 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23740%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for AZ23740: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for RW26653: 2
2026-03-29 18:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-29 18:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with scrape type 2
2026-03-29 18:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with scrape type 2
2026-03-29 18:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883, identifier: RW26653
2026-03-29 18:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-29 18:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653
2026-03-29 18:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a7e1c8e-d4dd-5f99-93e8-9e8989116883 with identifier: RW26653 to the API
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:14Z',
'fuel_type': 'petrol',
'id': '8a7e1c8e-d4dd-5f99-93e8-9e8989116883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW26653',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 28147,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-29',
'seller_name': None,
'title': 'Cupra Formentor 1.5 TSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Saving data for RW26653: {'auction_closing_time': 1774883174.0, 'created_time': 1773341713.150887, 'last_price_update_time': 1774809409.598945}
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW26653') HTTP/1.1" 204 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for MN42254: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF81751%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for GF81751: 0
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-29 18:36:49 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-29 18:36:49 [auto1.de] INFO: Scrape type for ZY72717: 2
2026-03-29 18:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-29 18:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with scrape type 2
2026-03-29 18:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with scrape type 2
2026-03-29 18:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9, identifier: ZY72717
2026-03-29 18:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-29 18:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-29 18:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717 to the API
2026-03-29 18:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 83,
'expiration_date': '2026-03-30T15:16:31Z',
'fuel_type': 'petrol',
'id': '7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY72717',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 126249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-27',
'seller_name': None,
'title': 'Dacia Lodgy 1.6 Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2013}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Saving data for ZY72717: {'auction_closing_time': 1774883791.0, 'created_time': 1774608566.910485, 'last_price_update_time': 1774809410.177217}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY72717') HTTP/1.1" 204 0
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS01911%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Scrape type for GS01911: 0
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Scrape type for UV04147: 2
2026-03-29 18:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-29 18:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d72083-c6bb-57af-b98d-4037629982b2 with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d72083-c6bb-57af-b98d-4037629982b2 with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2d72083-c6bb-57af-b98d-4037629982b2, identifier: UV04147
2026-03-29 18:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-29 18:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-29 18:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147 to the API
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:14:40Z',
'fuel_type': 'petrol',
'id': 'b2d72083-c6bb-57af-b98d-4037629982b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV04147',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 209674,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-06',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2009}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Saving data for UV04147: {'auction_closing_time': 1774883680.0, 'created_time': 1773305741.047526, 'last_price_update_time': 1774809410.630388}
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV04147') HTTP/1.1" 204 0
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-29 18:36:50 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-29 18:36:50 [auto1.de] INFO: Scrape type for JN93492: 2
2026-03-29 18:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-29 18:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87992e54-b8ab-516c-b637-17cf4457785d with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87992e54-b8ab-516c-b637-17cf4457785d with scrape type 2
2026-03-29 18:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87992e54-b8ab-516c-b637-17cf4457785d, identifier: JN93492
2026-03-29 18:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-29 18:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-29 18:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492 to the API
2026-03-29 18:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:11:06Z',
'fuel_type': 'petrol',
'id': '87992e54-b8ab-516c-b637-17cf4457785d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN93492',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 136744,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-25',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Edition 7 2WD',
'transmission': 'manual',
'trim': 'Edition 7 2WD',
'year': 2015}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Saving data for JN93492: {'auction_closing_time': 1774883466.0, 'created_time': 1774263097.869643, 'last_price_update_time': 1774809411.138412}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN93492') HTTP/1.1" 204 0
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Scrape type for AJ08614: 0
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-29 18:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:51 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Scrape type for XS27718: 0
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Scrape type for KJ86247: 2
2026-03-29 18:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-29 18:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba46270-addc-54d3-b949-b4eb8697481d with scrape type 2
2026-03-29 18:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ba46270-addc-54d3-b949-b4eb8697481d with scrape type 2
2026-03-29 18:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ba46270-addc-54d3-b949-b4eb8697481d, identifier: KJ86247
2026-03-29 18:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-29 18:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-29 18:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247 to the API
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 50,
'expiration_date': '2026-03-30T15:45:04Z',
'fuel_type': 'petrol',
'id': '5ba46270-addc-54d3-b949-b4eb8697481d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ86247',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Lupo',
'odometer': 87412,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-30',
'seller_name': None,
'title': 'Volkswagen Lupo 1.0 Oxford',
'transmission': 'manual',
'trim': 'Oxford',
'year': 2002}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Saving data for KJ86247: {'auction_closing_time': 1774885504.0, 'created_time': 1774118969.730182, 'last_price_update_time': 1774809411.855359}
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ86247') HTTP/1.1" 204 0
2026-03-29 18:36:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF22062%27 HTTP/1.1" 200 None
2026-03-29 18:36:51 [auto1.de] INFO: Scrape type for AF22062: 0
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-29 18:36:51 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH59067%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for FH59067: 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for YJ30839: 2
2026-03-29 18:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-29 18:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c, identifier: YJ30839
2026-03-29 18:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-29 18:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-29 18:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839 to the API
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:50:32Z',
'fuel_type': 'diesel',
'id': '61e3541e-02fa-5f2f-8b3a-019b4c59ff9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ30839',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 115221,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-01',
'seller_name': None,
'title': 'MINI Countryman Cooper SD ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2016}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Saving data for YJ30839: {'auction_closing_time': 1774885832.0, 'created_time': 1773305735.047043, 'last_price_update_time': 1774809412.453894}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ30839') HTTP/1.1" 204 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for BD68188: 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA27220%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for FA27220: 2
2026-03-29 18:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220
2026-03-29 18:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770609e7-6336-5339-920b-77f2f21ffbdd with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770609e7-6336-5339-920b-77f2f21ffbdd with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 770609e7-6336-5339-920b-77f2f21ffbdd, identifier: FA27220
2026-03-29 18:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220
2026-03-29 18:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220
2026-03-29 18:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 770609e7-6336-5339-920b-77f2f21ffbdd with identifier: FA27220 to the API
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:00Z',
'fuel_type': 'petrol',
'id': '770609e7-6336-5339-920b-77f2f21ffbdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA27220',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 73489,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-12',
'seller_name': None,
'title': 'Seat Leon 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2020}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA27220%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Saving data for FA27220: {'auction_closing_time': 1774884540.0, 'created_time': 1773382486.4619, 'last_price_update_time': 1774809412.906895}
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA27220') HTTP/1.1" 204 0
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-29 18:36:52 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-29 18:36:52 [auto1.de] INFO: Scrape type for MU83359: 2
2026-03-29 18:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-29 18:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf13c1a-e5d8-506a-a482-caba11daa539 with scrape type 2
2026-03-29 18:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bf13c1a-e5d8-506a-a482-caba11daa539 with scrape type 2
2026-03-29 18:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bf13c1a-e5d8-506a-a482-caba11daa539, identifier: MU83359
2026-03-29 18:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-29 18:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359
2026-03-29 18:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bf13c1a-e5d8-506a-a482-caba11daa539 with identifier: MU83359 to the API
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:50Z',
'fuel_type': 'diesel',
'id': '8bf13c1a-e5d8-506a-a482-caba11daa539',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU83359',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 201828,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-11',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-29 18:36:53 [auto1.de] INFO: Saving data for MU83359: {'auction_closing_time': 1774882970.0, 'created_time': 1774521888.655067, 'last_price_update_time': 1774809413.334758}
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU83359') HTTP/1.1" 204 0
2026-03-29 18:36:53 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-29 18:36:53 [auto1.de] INFO: Scrape type for VU87810: 2
2026-03-29 18:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-29 18:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2966244-205c-5a48-8407-8c2f6b4a6763 with scrape type 2
2026-03-29 18:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2966244-205c-5a48-8407-8c2f6b4a6763 with scrape type 2
2026-03-29 18:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2966244-205c-5a48-8407-8c2f6b4a6763, identifier: VU87810
2026-03-29 18:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 18:36:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-29 18:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810 to the API
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:51:35Z',
'fuel_type': 'diesel',
'id': 'd2966244-205c-5a48-8407-8c2f6b4a6763',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU87810',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 188480,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-18',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro Plus',
'transmission': 'automatic',
'trim': 'quattro Plus',
'year': 2016}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Saving data for VU87810: {'auction_closing_time': 1774885895.0, 'created_time': 1773307341.11041, 'last_price_update_time': 1774809414.095286}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU87810') HTTP/1.1" 204 0
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Scrape type for YS81106: 2
2026-03-29 18:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-29 18:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0684b6c-6f56-5f95-8f3d-5dd375dd0713, identifier: YS81106
2026-03-29 18:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-29 18:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-29 18:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106 to the API
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:37:43Z',
'fuel_type': 'petrol',
'id': 'b0684b6c-6f56-5f95-8f3d-5dd375dd0713',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS81106',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 35739,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-05',
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2022}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Saving data for YS81106: {'auction_closing_time': 1774885063.0, 'created_time': 1774607934.480418, 'last_price_update_time': 1774809414.616326}
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS81106') HTTP/1.1" 204 0
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-29 18:36:54 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-29 18:36:54 [auto1.de] INFO: Scrape type for HN35762: 2
2026-03-29 18:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-29 18:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb8930d2-a6d8-5270-81b2-7e99df3990b9 with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb8930d2-a6d8-5270-81b2-7e99df3990b9 with scrape type 2
2026-03-29 18:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb8930d2-a6d8-5270-81b2-7e99df3990b9, identifier: HN35762
2026-03-29 18:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-29 18:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-29 18:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762 to the API
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:19:44Z',
'fuel_type': 'diesel',
'id': 'bb8930d2-a6d8-5270-81b2-7e99df3990b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN35762',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 287654,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-04',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2017}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Saving data for HN35762: {'auction_closing_time': 1774883984.0, 'created_time': 1774293896.249834, 'last_price_update_time': 1774809415.062736}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN35762') HTTP/1.1" 204 0
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD63054%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for TD63054: 0
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for WP48993: 2
2026-03-29 18:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-29 18:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49459b97-75bf-558e-9c7e-010c02ad240e with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49459b97-75bf-558e-9c7e-010c02ad240e with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49459b97-75bf-558e-9c7e-010c02ad240e, identifier: WP48993
2026-03-29 18:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-29 18:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993
2026-03-29 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49459b97-75bf-558e-9c7e-010c02ad240e with identifier: WP48993 to the API
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 292,
'expiration_date': '2026-03-30T15:37:21Z',
'fuel_type': 'hybrid',
'id': '49459b97-75bf-558e-9c7e-010c02ad240e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP48993',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 82247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-04',
'seller_name': None,
'title': 'BMW 5er 530e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2022}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Saving data for WP48993: {'auction_closing_time': 1774885041.0, 'created_time': 1774522244.533686, 'last_price_update_time': 1774809415.514099}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP48993') HTTP/1.1" 204 0
2026-03-29 18:36:55 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-29 18:36:55 [auto1.de] INFO: Scrape type for NR54362: 2
2026-03-29 18:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362
2026-03-29 18:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0656b6-591f-56f2-b658-d83dbc88acae with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0656b6-591f-56f2-b658-d83dbc88acae with scrape type 2
2026-03-29 18:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec0656b6-591f-56f2-b658-d83dbc88acae, identifier: NR54362
2026-03-29 18:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362
2026-03-29 18:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362
2026-03-29 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec0656b6-591f-56f2-b658-d83dbc88acae with identifier: NR54362 to the API
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:23:43Z',
'fuel_type': 'petrol',
'id': 'ec0656b6-591f-56f2-b658-d83dbc88acae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR54362',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 33886,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-02',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-29 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Saving data for NR54362: {'auction_closing_time': 1774884223.0, 'created_time': 1774722982.60619, 'last_price_update_time': 1774809416.005136}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR54362') HTTP/1.1" 204 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for PU72162: 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for LS95970: 2
2026-03-29 18:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-29 18:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba with scrape type 2
2026-03-29 18:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba with scrape type 2
2026-03-29 18:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a95b3bf0-d1d9-5693-a56a-2595fc3236ba, identifier: LS95970
2026-03-29 18:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-29 18:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-29 18:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970 to the API
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:17Z',
'fuel_type': 'diesel',
'id': 'a95b3bf0-d1d9-5693-a56a-2595fc3236ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS95970',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 251863,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-05-29',
'seller_name': None,
'title': 'Mercedes-Benz Vito 115 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2005}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Saving data for LS95970: {'auction_closing_time': 1774885697.0, 'created_time': 1774608299.152545, 'last_price_update_time': 1774809416.441014}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS95970') HTTP/1.1" 204 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for GJ26621: 2
2026-03-29 18:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-29 18:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 319f1e69-4a71-5eb0-ba79-cf27219264b2 with scrape type 2
2026-03-29 18:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 319f1e69-4a71-5eb0-ba79-cf27219264b2 with scrape type 2
2026-03-29 18:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 319f1e69-4a71-5eb0-ba79-cf27219264b2, identifier: GJ26621
2026-03-29 18:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-29 18:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621
2026-03-29 18:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 319f1e69-4a71-5eb0-ba79-cf27219264b2 with identifier: GJ26621 to the API
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:11:49Z',
'fuel_type': 'petrol',
'id': '319f1e69-4a71-5eb0-ba79-cf27219264b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ26621',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 158933,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-04',
'seller_name': None,
'title': 'Renault Clio 1.2 Rip Curl',
'transmission': 'manual',
'trim': 'Rip Curl',
'year': 2007}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Saving data for GJ26621: {'auction_closing_time': 1774883509.0, 'created_time': 1773428533.767207, 'last_price_update_time': 1774809416.867118}
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ26621') HTTP/1.1" 204 0
2026-03-29 18:36:56 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 6740 | hits on page: 40
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU40538%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for BU40538: 0
2026-03-29 18:36:56 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-29 18:36:56 [auto1.de] INFO: Scrape type for KT21278: 2
2026-03-29 18:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-29 18:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa19068a-47ae-5428-a87d-12588a51a103 with scrape type 2
2026-03-29 18:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa19068a-47ae-5428-a87d-12588a51a103 with scrape type 2
2026-03-29 18:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa19068a-47ae-5428-a87d-12588a51a103, identifier: KT21278
2026-03-29 18:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-29 18:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278
2026-03-29 18:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa19068a-47ae-5428-a87d-12588a51a103 with identifier: KT21278 to the API
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:45:18Z',
'fuel_type': 'diesel',
'id': 'fa19068a-47ae-5428-a87d-12588a51a103',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT21278',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 240033,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-12',
'seller_name': None,
'title': 'Suzuki SX4 1.6 DDiS Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2015}
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Saving data for KT21278: {'auction_closing_time': 1774885518.0, 'created_time': 1774522481.556691, 'last_price_update_time': 1774809417.28319}
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT21278') HTTP/1.1" 204 0
2026-03-29 18:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ75608%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Scrape type for ZZ75608: 0
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT11127%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Scrape type for WT11127: 0
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Scrape type for NB76223: 2
2026-03-29 18:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-29 18:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4965aa78-b986-54e4-9159-09473ccee85c with scrape type 2
2026-03-29 18:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4965aa78-b986-54e4-9159-09473ccee85c with scrape type 2
2026-03-29 18:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4965aa78-b986-54e4-9159-09473ccee85c, identifier: NB76223
2026-03-29 18:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-29 18:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-29 18:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223 to the API
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:13:29Z',
'fuel_type': 'diesel',
'id': '4965aa78-b986-54e4-9159-09473ccee85c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB76223',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 260843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'Volkswagen Amarok 3.0 V6 TDI Aventura DoubleCab 4Motion',
'transmission': 'automatic',
'trim': 'Aventura DoubleCab 4Motion',
'year': 2020}
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Saving data for NB76223: {'auction_closing_time': 1774883609.0, 'created_time': 1773946906.485409, 'last_price_update_time': 1774809417.791202}
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB76223') HTTP/1.1" 204 0
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-29 18:36:57 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-29 18:36:57 [auto1.de] INFO: Scrape type for PC86421: 2
2026-03-29 18:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-29 18:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651a4870-40ff-5f5b-bfb9-2faf21646919 with scrape type 2
2026-03-29 18:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 651a4870-40ff-5f5b-bfb9-2faf21646919 with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 651a4870-40ff-5f5b-bfb9-2faf21646919, identifier: PC86421
2026-03-29 18:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-29 18:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-29 18:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421 to the API
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:12:28Z',
'fuel_type': 'diesel',
'id': '651a4870-40ff-5f5b-bfb9-2faf21646919',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC86421',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 96002,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-21',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L1H1 Ka 2,8t',
'transmission': 'manual',
'trim': 'L1H1 Ka 2,8t',
'year': 2014}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Saving data for PC86421: {'auction_closing_time': 1774883548.0, 'created_time': 1773304798.900836, 'last_price_update_time': 1774809418.370497}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC86421') HTTP/1.1" 204 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for NY81856: 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV10868%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for UV10868: 2
2026-03-29 18:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868
2026-03-29 18:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b, identifier: UV10868
2026-03-29 18:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868
2026-03-29 18:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868
2026-03-29 18:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b with identifier: UV10868 to the API
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:21:45Z',
'fuel_type': 'diesel',
'id': 'a9b601c9-d3fd-5b24-bb3e-0db95a3ea99b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV10868',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 154362,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-24',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 250 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2012}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV10868%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Saving data for UV10868: {'auction_closing_time': 1774884105.0, 'created_time': 1774031937.953908, 'last_price_update_time': 1774809418.841696}
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV10868') HTTP/1.1" 204 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55546%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for SY55546: 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10723%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for PA10723: 0
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-29 18:36:58 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-29 18:36:58 [auto1.de] INFO: Scrape type for ZZ74816: 2
2026-03-29 18:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816
2026-03-29 18:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with scrape type 2
2026-03-29 18:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae, identifier: ZZ74816
2026-03-29 18:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816
2026-03-29 18:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816
2026-03-29 18:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6d8ee31-fc06-59bb-b40e-9cd0dca274ae with identifier: ZZ74816 to the API
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:33:30Z',
'fuel_type': 'diesel',
'id': 'e6d8ee31-fc06-59bb-b40e-9cd0dca274ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ74816',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 315136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-14',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 319 CDI RWD L2',
'transmission': 'automatic',
'trim': 'RWD L2',
'year': 2021}
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Saving data for ZZ74816: {'auction_closing_time': 1774884810.0, 'created_time': 1773305968.883548, 'last_price_update_time': 1774809419.293065}
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ74816') HTTP/1.1" 204 0
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Scrape type for RP43844: 2
2026-03-29 18:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-29 18:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 088df3e3-9235-5b9d-a75d-1adfcfabf07a with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 088df3e3-9235-5b9d-a75d-1adfcfabf07a with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 088df3e3-9235-5b9d-a75d-1adfcfabf07a, identifier: RP43844
2026-03-29 18:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-29 18:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844
2026-03-29 18:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 088df3e3-9235-5b9d-a75d-1adfcfabf07a with identifier: RP43844 to the API
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:44:37Z',
'fuel_type': 'diesel',
'id': '088df3e3-9235-5b9d-a75d-1adfcfabf07a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP43844',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 242153,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-26',
'seller_name': None,
'title': 'Ford S-Max 2.2 TDCi Titanium S',
'transmission': 'manual',
'trim': 'Titanium S',
'year': 2009}
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Saving data for RP43844: {'auction_closing_time': 1774885477.0, 'created_time': 1774521789.034606, 'last_price_update_time': 1774809419.821583}
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP43844') HTTP/1.1" 204 0
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-29 18:36:59 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-29 18:36:59 [auto1.de] INFO: Scrape type for YD55328: 2
2026-03-29 18:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-29 18:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64981901-77f8-5c58-9f59-24ac9625466a with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64981901-77f8-5c58-9f59-24ac9625466a with scrape type 2
2026-03-29 18:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64981901-77f8-5c58-9f59-24ac9625466a, identifier: YD55328
2026-03-29 18:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-29 18:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-29 18:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328 to the API
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:03:25Z',
'fuel_type': 'diesel',
'id': '64981901-77f8-5c58-9f59-24ac9625466a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD55328',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 84322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-02',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2019}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Saving data for YD55328: {'auction_closing_time': 1774883005.0, 'created_time': 1773381308.776175, 'last_price_update_time': 1774809420.364709}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD55328') HTTP/1.1" 204 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for UT27249: 2
2026-03-29 18:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-29 18:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b59a7cea-af21-5908-bdc4-bd25df04a4db with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b59a7cea-af21-5908-bdc4-bd25df04a4db with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b59a7cea-af21-5908-bdc4-bd25df04a4db, identifier: UT27249
2026-03-29 18:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-29 18:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-29 18:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249 to the API
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:48:40Z',
'fuel_type': 'petrol',
'id': 'b59a7cea-af21-5908-bdc4-bd25df04a4db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT27249',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 122874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-17',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2015}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Saving data for UT27249: {'auction_closing_time': 1774885720.0, 'created_time': 1774608789.086783, 'last_price_update_time': 1774809420.829271}
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT27249') HTTP/1.1" 204 0
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-29 18:37:00 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-29 18:37:00 [auto1.de] INFO: Scrape type for WG27498: 2
2026-03-29 18:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-29 18:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab57346c-902d-5270-9bcf-0bc1117b2856 with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab57346c-902d-5270-9bcf-0bc1117b2856 with scrape type 2
2026-03-29 18:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab57346c-902d-5270-9bcf-0bc1117b2856, identifier: WG27498
2026-03-29 18:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-29 18:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498
2026-03-29 18:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab57346c-902d-5270-9bcf-0bc1117b2856 with identifier: WG27498 to the API
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:36:51Z',
'fuel_type': 'petrol',
'id': 'ab57346c-902d-5270-9bcf-0bc1117b2856',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG27498',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 107790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-29',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2004}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Saving data for WG27498: {'auction_closing_time': 1774885011.0, 'created_time': 1774522478.641982, 'last_price_update_time': 1774809421.253025}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG27498') HTTP/1.1" 204 0
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-29 18:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:01 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-29 18:37:01 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Scrape type for ZZ71304: 2
2026-03-29 18:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-29 18:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110572ef-11c3-5e40-afde-5b395c5fe3a4 with scrape type 2
2026-03-29 18:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110572ef-11c3-5e40-afde-5b395c5fe3a4 with scrape type 2
2026-03-29 18:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 110572ef-11c3-5e40-afde-5b395c5fe3a4, identifier: ZZ71304
2026-03-29 18:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-29 18:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-29 18:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304 to the API
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:00:04Z',
'fuel_type': 'petrol',
'id': '110572ef-11c3-5e40-afde-5b395c5fe3a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ71304',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 114935,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-14',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-29 18:37:01 [auto1.de] INFO: Saving data for ZZ71304: {'auction_closing_time': 1774882804.0, 'created_time': 1773861825.663401, 'last_price_update_time': 1774809421.976293}
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ71304') HTTP/1.1" 204 0
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Scrape type for LN76006: 2
2026-03-29 18:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-29 18:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827e53f6-71f1-56d4-836d-e4df1f3968a1 with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827e53f6-71f1-56d4-836d-e4df1f3968a1 with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 827e53f6-71f1-56d4-836d-e4df1f3968a1, identifier: LN76006
2026-03-29 18:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-29 18:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006
2026-03-29 18:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 827e53f6-71f1-56d4-836d-e4df1f3968a1 with identifier: LN76006 to the API
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:29:41Z',
'fuel_type': 'petrol',
'id': '827e53f6-71f1-56d4-836d-e4df1f3968a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN76006',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 42146,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-05',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Saving data for LN76006: {'auction_closing_time': 1774884581.0, 'created_time': 1774522260.039164, 'last_price_update_time': 1774809422.465873}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN76006') HTTP/1.1" 204 0
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Scrape type for CU86908: 2
2026-03-29 18:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-29 18:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8, identifier: CU86908
2026-03-29 18:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-29 18:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-29 18:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908 to the API
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:09:18Z',
'fuel_type': 'diesel',
'id': 'b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU86908',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i40',
'odometer': 219979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-29',
'seller_name': None,
'title': 'Hyundai i40 1.7 CRDi Trend Blue',
'transmission': 'automatic',
'trim': 'Trend Blue',
'year': 2016}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Saving data for CU86908: {'auction_closing_time': 1774883358.0, 'created_time': 1773689314.152203, 'last_price_update_time': 1774809422.943931}
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU86908') HTTP/1.1" 204 0
2026-03-29 18:37:02 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-29 18:37:02 [auto1.de] INFO: Scrape type for JC14398: 2
2026-03-29 18:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-29 18:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with scrape type 2
2026-03-29 18:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with scrape type 2
2026-03-29 18:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f, identifier: JC14398
2026-03-29 18:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-29 18:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398
2026-03-29 18:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f with identifier: JC14398 to the API
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:20:58Z',
'fuel_type': 'diesel',
'id': 'aaa2ca9c-a79a-58e7-9dbf-bff384d14a1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC14398',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 125673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-26',
'seller_name': None,
'title': 'BMW 5er 525d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Saving data for JC14398: {'auction_closing_time': 1774884058.0, 'created_time': 1773861772.827467, 'last_price_update_time': 1774809423.373592}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC14398') HTTP/1.1" 204 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC88789%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for HC88789: 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14062%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for JM14062: 0
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-29 18:37:03 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Scrape type for SA96746: 2
2026-03-29 18:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-29 18:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34e5599-ba6f-5240-a887-6b4cfbb9a79f with scrape type 2
2026-03-29 18:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c34e5599-ba6f-5240-a887-6b4cfbb9a79f with scrape type 2
2026-03-29 18:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c34e5599-ba6f-5240-a887-6b4cfbb9a79f, identifier: SA96746
2026-03-29 18:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-29 18:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-29 18:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746 to the API
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:41:29Z',
'fuel_type': 'hybrid',
'id': 'c34e5599-ba6f-5240-a887-6b4cfbb9a79f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA96746',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 21082,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-29',
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2022}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-29 18:37:03 [auto1.de] INFO: Saving data for SA96746: {'auction_closing_time': 1774885289.0, 'created_time': 1773307197.38271, 'last_price_update_time': 1774809423.913655}
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA96746') HTTP/1.1" 204 0
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Scrape type for HJ79355: 2
2026-03-29 18:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-29 18:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8737b35-09db-5ffe-a6f5-bf867542d5dd with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8737b35-09db-5ffe-a6f5-bf867542d5dd with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8737b35-09db-5ffe-a6f5-bf867542d5dd, identifier: HJ79355
2026-03-29 18:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-29 18:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-29 18:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355 to the API
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:14Z',
'fuel_type': 'diesel',
'id': 'b8737b35-09db-5ffe-a6f5-bf867542d5dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ79355',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 181415,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-07',
'seller_name': None,
'title': 'Audi A3 Limousine 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Saving data for HJ79355: {'auction_closing_time': 1774883474.0, 'created_time': 1773831886.630188, 'last_price_update_time': 1774809424.53254}
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ79355') HTTP/1.1" 204 0
2026-03-29 18:37:04 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-29 18:37:04 [auto1.de] INFO: Scrape type for ZE36621: 2
2026-03-29 18:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-29 18:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e609153-b640-5eba-a52a-66dc06e6e251 with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e609153-b640-5eba-a52a-66dc06e6e251 with scrape type 2
2026-03-29 18:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e609153-b640-5eba-a52a-66dc06e6e251, identifier: ZE36621
2026-03-29 18:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 18:37:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621
2026-03-29 18:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e609153-b640-5eba-a52a-66dc06e6e251 with identifier: ZE36621 to the API
2026-03-29 18:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 381,
'expiration_date': '2026-03-30T15:01:54Z',
'fuel_type': 'hybrid',
'id': '3e609153-b640-5eba-a52a-66dc06e6e251',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE36621',
'listing': 'auction',
'make': 'Jeep',
'model': 'Wrangler Unlimited',
'odometer': 9299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-02',
'seller_name': None,
'title': 'Jeep Wrangler Unlimited 2.0 4xe Plug-in Hybrid Sahara',
'transmission': 'automatic',
'trim': 'Sahara',
'year': 2023}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Saving data for ZE36621: {'auction_closing_time': 1774882914.0, 'created_time': 1774522255.372006, 'last_price_update_time': 1774809425.110198}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE36621') HTTP/1.1" 204 0
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Scrape type for HB27474: 2
2026-03-29 18:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-29 18:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ee91dc-75c7-5a56-b5df-750e5fd39584 with scrape type 2
2026-03-29 18:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ee91dc-75c7-5a56-b5df-750e5fd39584 with scrape type 2
2026-03-29 18:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0ee91dc-75c7-5a56-b5df-750e5fd39584, identifier: HB27474
2026-03-29 18:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-29 18:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-29 18:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474 to the API
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:56:56Z',
'fuel_type': 'petrol',
'id': 'c0ee91dc-75c7-5a56-b5df-750e5fd39584',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB27474',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 95609,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-17',
'seller_name': None,
'title': 'Toyota Yaris 1.33 Dual VVT-i Edition-S',
'transmission': 'manual',
'trim': 'Edition-S',
'year': 2016}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Saving data for HB27474: {'auction_closing_time': 1774886216.0, 'created_time': 1774263226.954427, 'last_price_update_time': 1774809425.556272}
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB27474') HTTP/1.1" 204 0
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-29 18:37:05 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-29 18:37:05 [auto1.de] INFO: Scrape type for XZ46710: 2
2026-03-29 18:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-29 18:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with scrape type 2
2026-03-29 18:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with scrape type 2
2026-03-29 18:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053, identifier: XZ46710
2026-03-29 18:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-29 18:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-29 18:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710 to the API
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'petrol',
'id': '86ca72a1-cfb2-599e-8fe4-7e4ed134f053',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ46710',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 142565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-07',
'seller_name': None,
'title': 'Chevrolet Captiva 2.4 LS 2WD',
'transmission': 'manual',
'trim': 'LS 2WD',
'year': 2010}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Saving data for XZ46710: {'auction_closing_time': 1774884844.0, 'created_time': 1773304326.026895, 'last_price_update_time': 1774809426.011406}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ46710') HTTP/1.1" 204 0
2026-03-29 18:37:06 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Scrape type for BZ86499: 0
2026-03-29 18:37:06 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-29 18:37:06 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Scrape type for EG31023: 2
2026-03-29 18:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-29 18:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2d629e-f7bd-5759-a148-41bc07909644 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2d629e-f7bd-5759-a148-41bc07909644 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d2d629e-f7bd-5759-a148-41bc07909644, identifier: EG31023
2026-03-29 18:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-29 18:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023
2026-03-29 18:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d2d629e-f7bd-5759-a148-41bc07909644 with identifier: EG31023 to the API
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 389,
'expiration_date': '2026-03-30T15:48:59Z',
'fuel_type': 'petrol',
'id': '3d2d629e-f7bd-5759-a148-41bc07909644',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG31023',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 145862,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-14',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 450 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Saving data for EG31023: {'auction_closing_time': 1774885739.0, 'created_time': 1773686325.407926, 'last_price_update_time': 1774809426.474129}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG31023') HTTP/1.1" 204 0
2026-03-29 18:37:06 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Scrape type for NZ72675: 2
2026-03-29 18:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-29 18:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b691e249-a160-5e5a-b294-f25dca43bf91 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b691e249-a160-5e5a-b294-f25dca43bf91 with scrape type 2
2026-03-29 18:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b691e249-a160-5e5a-b294-f25dca43bf91, identifier: NZ72675
2026-03-29 18:37:06 [scrapy.extensions.logstats] INFO: Crawled 36 pages (at 9 pages/min), scraped 138 items (at 120 items/min)
2026-03-29 18:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-29 18:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-29 18:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675 to the API
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:42Z',
'fuel_type': 'diesel',
'id': 'b691e249-a160-5e5a-b294-f25dca43bf91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ72675',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 65341,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-05',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2024}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-29 18:37:06 [auto1.de] INFO: Saving data for NZ72675: {'auction_closing_time': 1774883022.0, 'created_time': 1774291613.56682, 'last_price_update_time': 1774809426.951762}
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ72675') HTTP/1.1" 204 0
2026-03-29 18:37:07 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-29 18:37:07 [auto1.de] INFO: Scrape type for EY45109: 2
2026-03-29 18:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-29 18:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91feca9-5fc7-57b4-aa02-9fa16808159e with scrape type 2
2026-03-29 18:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91feca9-5fc7-57b4-aa02-9fa16808159e with scrape type 2
2026-03-29 18:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e91feca9-5fc7-57b4-aa02-9fa16808159e, identifier: EY45109
2026-03-29 18:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-29 18:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-29 18:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109 to the API
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:12:37Z',
'fuel_type': 'petrol',
'id': 'e91feca9-5fc7-57b4-aa02-9fa16808159e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY45109',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 138328,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-21',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-29 18:37:07 [auto1.de] INFO: Saving data for EY45109: {'auction_closing_time': 1774883557.0, 'created_time': 1773772543.133384, 'last_price_update_time': 1774809427.706723}
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY45109') HTTP/1.1" 204 0
2026-03-29 18:37:07 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-29 18:37:07 [auto1.de] INFO: Scrape type for XR69964: 2
2026-03-29 18:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-29 18:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with scrape type 2
2026-03-29 18:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with scrape type 2
2026-03-29 18:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34ea99b0-957c-5d11-ac60-e10e72cfdb88, identifier: XR69964
2026-03-29 18:37:07 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-29 18:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-29 18:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964 to the API
2026-03-29 18:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:01:21Z',
'fuel_type': 'petrol',
'id': '34ea99b0-957c-5d11-ac60-e10e72cfdb88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR69964',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 159236,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-04',
'seller_name': None,
'title': 'Seat Leon 1.2 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Saving data for XR69964: {'auction_closing_time': 1774882881.0, 'created_time': 1773732952.323723, 'last_price_update_time': 1774809428.193756}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR69964') HTTP/1.1" 204 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for PE27175: 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN86054%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for TN86054: 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for LZ26330: 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for DJ80434: 2
2026-03-29 18:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-29 18:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with scrape type 2
2026-03-29 18:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with scrape type 2
2026-03-29 18:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e, identifier: DJ80434
2026-03-29 18:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-29 18:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-29 18:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434 to the API
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:31:55Z',
'fuel_type': 'diesel',
'id': '289ee44b-35a2-5b13-bbc6-fdac120b2f7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ80434',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 282273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-06',
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Saving data for DJ80434: {'auction_closing_time': 1774884715.0, 'created_time': 1774264339.259533, 'last_price_update_time': 1774809428.772823}
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ80434') HTTP/1.1" 204 0
2026-03-29 18:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL70058%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for KL70058: 0
2026-03-29 18:37:08 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-29 18:37:08 [auto1.de] INFO: Scrape type for CS56497: 2
2026-03-29 18:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-29 18:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with scrape type 2
2026-03-29 18:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d, identifier: CS56497
2026-03-29 18:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-29 18:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-29 18:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497 to the API
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:50:57Z',
'fuel_type': 'diesel',
'id': 'ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS56497',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 98752,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-12',
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
'transmission': 'automatic',
'trim': 'Q4 Lusso',
'year': 2020}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Saving data for CS56497: {'auction_closing_time': 1774885857.0, 'created_time': 1774291223.832113, 'last_price_update_time': 1774809429.358744}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS56497') HTTP/1.1" 204 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for ZZ01082: 2
2026-03-29 18:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-29 18:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a, identifier: ZZ01082
2026-03-29 18:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-29 18:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082
2026-03-29 18:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcee49b7-5e93-5ce3-84c1-f6fb6b73291a with identifier: ZZ01082 to the API
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:11:32Z',
'fuel_type': 'petrol',
'id': 'dcee49b7-5e93-5ce3-84c1-f6fb6b73291a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ01082',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 54025,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-28',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Cool Plus',
'transmission': 'manual',
'trim': 'Cool Plus',
'year': 2021}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Saving data for ZZ01082: {'auction_closing_time': 1774883492.0, 'created_time': 1774521718.402582, 'last_price_update_time': 1774809429.779625}
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ01082') HTTP/1.1" 204 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB97674%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for ZB97674: 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for MB83489: 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV51967%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for DV51967: 0
2026-03-29 18:37:09 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-29 18:37:09 [auto1.de] INFO: Scrape type for TD26953: 2
2026-03-29 18:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-29 18:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with scrape type 2
2026-03-29 18:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a876a45-a5c3-5dc1-9582-b545d2f499d4, identifier: TD26953
2026-03-29 18:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-29 18:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-29 18:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953 to the API
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:17Z',
'fuel_type': 'diesel',
'id': '7a876a45-a5c3-5dc1-9582-b545d2f499d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD26953',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 209908,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2013}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Saving data for TD26953: {'auction_closing_time': 1774885337.0, 'created_time': 1773686361.194888, 'last_price_update_time': 1774809430.302949}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD26953') HTTP/1.1" 204 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM98978%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for TM98978: 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU76337%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for NU76337: 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for BN23533: 2
2026-03-29 18:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-29 18:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with scrape type 2
2026-03-29 18:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with scrape type 2
2026-03-29 18:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12, identifier: BN23533
2026-03-29 18:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-29 18:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-29 18:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533 to the API
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:14:06Z',
'fuel_type': 'petrol',
'id': '20ed1ddb-9bae-59ae-a83e-22dd22bc2f12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN23533',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 45668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-08',
'seller_name': None,
'title': 'Seat Leon 1.0 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2019}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Saving data for BN23533: {'auction_closing_time': 1774883646.0, 'created_time': 1773858940.22156, 'last_price_update_time': 1774809430.837262}
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN23533') HTTP/1.1" 204 0
2026-03-29 18:37:10 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS44912%27 HTTP/1.1" 200 None
2026-03-29 18:37:10 [auto1.de] INFO: Scrape type for BS44912: 2
2026-03-29 18:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912
2026-03-29 18:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with scrape type 2
2026-03-29 18:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba, identifier: BS44912
2026-03-29 18:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912
2026-03-29 18:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912
2026-03-29 18:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c0393b9-8a7c-5d97-a435-7a1c125fc4ba with identifier: BS44912 to the API
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:58:34Z',
'fuel_type': 'petrol',
'id': '5c0393b9-8a7c-5d97-a435-7a1c125fc4ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS44912',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 76891,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-29',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2015}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS44912%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Saving data for BS44912: {'auction_closing_time': 1774886314.0, 'created_time': 1774722990.791097, 'last_price_update_time': 1774809431.371316}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS44912') HTTP/1.1" 204 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for HA98993: 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82708%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for SA82708: 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for XT50939: 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for JA25299: 2
2026-03-29 18:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-29 18:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132, identifier: JA25299
2026-03-29 18:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-29 18:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-29 18:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299 to the API
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:44:29Z',
'fuel_type': 'petrol',
'id': '7db8dd64-8d7e-5bc4-ab81-7a4f73128132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA25299',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 36660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-06',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2021}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Saving data for JA25299: {'auction_closing_time': 1774885469.0, 'created_time': 1773383012.053168, 'last_price_update_time': 1774809431.879167}
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA25299') HTTP/1.1" 204 0
2026-03-29 18:37:11 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-29 18:37:11 [auto1.de] INFO: Scrape type for PC67993: 2
2026-03-29 18:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-29 18:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with scrape type 2
2026-03-29 18:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a9dd63b-601b-58b1-8d37-652a2b0e1343, identifier: PC67993
2026-03-29 18:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-29 18:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993
2026-03-29 18:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a9dd63b-601b-58b1-8d37-652a2b0e1343 with identifier: PC67993 to the API
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:26Z',
'fuel_type': 'petrol',
'id': '4a9dd63b-601b-58b1-8d37-652a2b0e1343',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC67993',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 122839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-22',
'seller_name': None,
'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Saving data for PC67993: {'auction_closing_time': 1774885646.0, 'created_time': 1773426946.145049, 'last_price_update_time': 1774809432.285794}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC67993') HTTP/1.1" 204 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS38799%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for GS38799: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for ZC13254: 2
2026-03-29 18:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-29 18:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5bff240-ac6e-58e7-811d-b4244204b4ea with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5bff240-ac6e-58e7-811d-b4244204b4ea with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5bff240-ac6e-58e7-811d-b4244204b4ea, identifier: ZC13254
2026-03-29 18:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-29 18:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-29 18:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254 to the API
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:15:29Z',
'fuel_type': 'diesel',
'id': 'b5bff240-ac6e-58e7-811d-b4244204b4ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC13254',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 255829,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-03',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2016}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Saving data for ZC13254: {'auction_closing_time': 1774883729.0, 'created_time': 1773307849.083539, 'last_price_update_time': 1774809432.856303}
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC13254') HTTP/1.1" 204 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for WW51915: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU54451%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for CU54451: 0
2026-03-29 18:37:12 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-29 18:37:12 [auto1.de] INFO: Scrape type for FN85650: 2
2026-03-29 18:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-29 18:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1c2e178-ce7f-5b09-8064-be885d0c3f8f with scrape type 2
2026-03-29 18:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1c2e178-ce7f-5b09-8064-be885d0c3f8f with scrape type 2
2026-03-29 18:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1c2e178-ce7f-5b09-8064-be885d0c3f8f, identifier: FN85650
2026-03-29 18:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-29 18:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-29 18:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650 to the API
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:25:32Z',
'fuel_type': 'diesel',
'id': 'c1c2e178-ce7f-5b09-8064-be885d0c3f8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN85650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 254257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-05',
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2009}
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Saving data for FN85650: {'auction_closing_time': 1774884332.0, 'created_time': 1773303224.078945, 'last_price_update_time': 1774809433.36832}
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN85650') HTTP/1.1" 204 0
2026-03-29 18:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:13 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09122%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Scrape type for FV09122: 0
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Scrape type for SA80165: 0
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-29 18:37:13 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-29 18:37:13 [auto1.de] INFO: Scrape type for RU29030: 2
2026-03-29 18:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-29 18:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with scrape type 2
2026-03-29 18:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with scrape type 2
2026-03-29 18:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7dd30f-fe61-5917-8a71-83b37c2f8e07, identifier: RU29030
2026-03-29 18:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-29 18:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-29 18:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030 to the API
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:46:56Z',
'fuel_type': 'diesel',
'id': 'fa7dd30f-fe61-5917-8a71-83b37c2f8e07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU29030',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 69046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-24',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Move',
'transmission': 'automatic',
'trim': 'Move',
'year': 2021}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Saving data for RU29030: {'auction_closing_time': 1774885616.0, 'created_time': 1773381073.093071, 'last_price_update_time': 1774809434.00924}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU29030') HTTP/1.1" 204 0
2026-03-29 18:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36706%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for HD36706: 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN32284%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for NN32284: 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for MM33078: 2
2026-03-29 18:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-29 18:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0, identifier: MM33078
2026-03-29 18:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-29 18:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078
2026-03-29 18:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0 with identifier: MM33078 to the API
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:32Z',
'fuel_type': 'diesel',
'id': 'bc6d55b9-393c-5628-ae3c-ae2b58ce5bb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM33078',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 174518,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-21',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2013}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Saving data for MM33078: {'auction_closing_time': 1774885112.0, 'created_time': 1774522279.14601, 'last_price_update_time': 1774809434.577851}
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM33078') HTTP/1.1" 204 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU43264%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for RU43264: 0
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-29 18:37:14 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-29 18:37:14 [auto1.de] INFO: Scrape type for VF70690: 2
2026-03-29 18:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690
2026-03-29 18:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c95265d7-e0e8-536b-a6d8-884c28214667 with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c95265d7-e0e8-536b-a6d8-884c28214667 with scrape type 2
2026-03-29 18:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c95265d7-e0e8-536b-a6d8-884c28214667, identifier: VF70690
2026-03-29 18:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690
2026-03-29 18:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690
2026-03-29 18:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c95265d7-e0e8-536b-a6d8-884c28214667 with identifier: VF70690 to the API
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:58:59Z',
'fuel_type': 'petrol',
'id': 'c95265d7-e0e8-536b-a6d8-884c28214667',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF70690',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 194587,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-25',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2008}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Saving data for VF70690: {'auction_closing_time': 1774886339.0, 'created_time': 1774033917.359593, 'last_price_update_time': 1774809435.06177}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF70690') HTTP/1.1" 204 0
2026-03-29 18:37:15 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Scrape type for CP54704: 2
2026-03-29 18:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-29 18:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c, identifier: CP54704
2026-03-29 18:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-29 18:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-29 18:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704 to the API
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:58:33Z',
'fuel_type': 'diesel',
'id': 'c9cf7670-9fcc-535f-8fce-5ba5a944cd9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP54704',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 227355,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-08',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2018}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Saving data for CP54704: {'auction_closing_time': 1774886313.0, 'created_time': 1773302641.74825, 'last_price_update_time': 1774809435.636584}
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP54704') HTTP/1.1" 204 0
2026-03-29 18:37:15 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-29 18:37:15 [auto1.de] INFO: Scrape type for FG21922: 2
2026-03-29 18:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-29 18:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a19041cf-b367-503c-a784-1156b1400523 with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a19041cf-b367-503c-a784-1156b1400523 with scrape type 2
2026-03-29 18:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a19041cf-b367-503c-a784-1156b1400523, identifier: FG21922
2026-03-29 18:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-29 18:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-29 18:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922 to the API
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 408,
'expiration_date': '2026-03-30T15:32:10Z',
'fuel_type': 'petrol',
'id': 'a19041cf-b367-503c-a784-1156b1400523',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG21922',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'M-Klasse',
'odometer': 163277,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-26',
'seller_name': None,
'title': 'Mercedes-Benz M-Klasse ML 500 BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2013}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Saving data for FG21922: {'auction_closing_time': 1774884730.0, 'created_time': 1773428276.187695, 'last_price_update_time': 1774809436.113294}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG21922') HTTP/1.1" 204 0
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90361%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Scrape type for SE90361: 0
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Scrape type for JB35967: 2
2026-03-29 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-29 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53, identifier: JB35967
2026-03-29 18:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-29 18:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-29 18:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967 to the API
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:28Z',
'fuel_type': 'diesel',
'id': '9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB35967',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 102835,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-15',
'seller_name': None,
'title': 'Volkswagen Beetle 2.0 TDI Design BlueMotion',
'transmission': 'manual',
'trim': 'Design BlueMotion',
'year': 2018}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Saving data for JB35967: {'auction_closing_time': 1774884568.0, 'created_time': 1773427072.237348, 'last_price_update_time': 1774809436.581238}
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB35967') HTTP/1.1" 204 0
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS56665%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Scrape type for ZS56665: 0
2026-03-29 18:37:16 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-29 18:37:16 [auto1.de] INFO: Scrape type for YM40569: 2
2026-03-29 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-29 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87913c5e-f7ee-5805-8e0d-3222a563c492 with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87913c5e-f7ee-5805-8e0d-3222a563c492 with scrape type 2
2026-03-29 18:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87913c5e-f7ee-5805-8e0d-3222a563c492, identifier: YM40569
2026-03-29 18:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-29 18:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-29 18:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569 to the API
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:43:58Z',
'fuel_type': 'petrol',
'id': '87913c5e-f7ee-5805-8e0d-3222a563c492',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM40569',
'listing': 'auction',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 143743,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-12',
'seller_name': None,
'title': 'Skoda Citigo 1.0 MPI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2012}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Saving data for YM40569: {'auction_closing_time': 1774885438.0, 'created_time': 1774264127.95052, 'last_price_update_time': 1774809437.060091}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM40569') HTTP/1.1" 204 0
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Scrape type for EV72489: 2
2026-03-29 18:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-29 18:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83963d0e-2d9c-545a-9406-f116e26815a7 with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83963d0e-2d9c-545a-9406-f116e26815a7 with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83963d0e-2d9c-545a-9406-f116e26815a7, identifier: EV72489
2026-03-29 18:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-29 18:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489
2026-03-29 18:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83963d0e-2d9c-545a-9406-f116e26815a7 with identifier: EV72489 to the API
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:59:07Z',
'fuel_type': 'diesel',
'id': '83963d0e-2d9c-545a-9406-f116e26815a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV72489',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 200824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-26',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Individual',
'transmission': 'automatic',
'trim': 'Individual',
'year': 2016}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Saving data for EV72489: {'auction_closing_time': 1774886347.0, 'created_time': 1774521576.00924, 'last_price_update_time': 1774809437.463873}
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV72489') HTTP/1.1" 204 0
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-29 18:37:17 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-29 18:37:17 [auto1.de] INFO: Scrape type for CF89653: 2
2026-03-29 18:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-29 18:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002da1e5-5e02-52ba-8992-d13c635d9cd1 with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002da1e5-5e02-52ba-8992-d13c635d9cd1 with scrape type 2
2026-03-29 18:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 002da1e5-5e02-52ba-8992-d13c635d9cd1, identifier: CF89653
2026-03-29 18:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-29 18:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-29 18:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653 to the API
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:31:28Z',
'fuel_type': 'diesel',
'id': '002da1e5-5e02-52ba-8992-d13c635d9cd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF89653',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 144065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-09',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Saving data for CF89653: {'auction_closing_time': 1774884688.0, 'created_time': 1774035057.384842, 'last_price_update_time': 1774809438.0195}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF89653') HTTP/1.1" 204 0
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB04317%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for WB04317: 0
2026-03-29 18:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:18 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for RC50586: 2
2026-03-29 18:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-29 18:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 685be0a8-2cb0-510c-8e02-d2a2d364834b with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 685be0a8-2cb0-510c-8e02-d2a2d364834b with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 685be0a8-2cb0-510c-8e02-d2a2d364834b, identifier: RC50586
2026-03-29 18:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-29 18:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-29 18:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586 to the API
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:20Z',
'fuel_type': 'petrol',
'id': '685be0a8-2cb0-510c-8e02-d2a2d364834b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC50586',
'listing': 'auction',
'make': 'Honda',
'model': 'CR-V',
'odometer': 182998,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-29',
'seller_name': None,
'title': 'Honda CR-V 2.0 VTEC Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Saving data for RC50586: {'auction_closing_time': 1774884620.0, 'created_time': 1773772767.037647, 'last_price_update_time': 1774809438.755555}
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC50586') HTTP/1.1" 204 0
2026-03-29 18:37:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:18 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-29 18:37:18 [auto1.de] INFO: Scrape type for SJ63454: 2
2026-03-29 18:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-29 18:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with scrape type 2
2026-03-29 18:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3, identifier: SJ63454
2026-03-29 18:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-29 18:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454
2026-03-29 18:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3 with identifier: SJ63454 to the API
2026-03-29 18:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:17:47Z',
'fuel_type': 'petrol',
'id': '5ce2e9d6-4ce0-5dd1-b422-c3ee875306f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ63454',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 182944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-23',
'seller_name': None,
'title': 'BMW 2er 220i Gran Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Saving data for SJ63454: {'auction_closing_time': 1774883867.0, 'created_time': 1773946199.319927, 'last_price_update_time': 1774809439.176749}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ63454') HTTP/1.1" 204 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78025%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for LD78025: 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for AR19685: 2
2026-03-29 18:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-29 18:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with scrape type 2
2026-03-29 18:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with scrape type 2
2026-03-29 18:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bac0db4c-2fb6-50ca-9e6a-94a67850eed9, identifier: AR19685
2026-03-29 18:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-29 18:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-29 18:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685 to the API
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:06:49Z',
'fuel_type': 'hybrid',
'id': 'bac0db4c-2fb6-50ca-9e6a-94a67850eed9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR19685',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 84667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-18',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Saving data for AR19685: {'auction_closing_time': 1774883209.0, 'created_time': 1773301624.038718, 'last_price_update_time': 1774809439.77218}
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR19685') HTTP/1.1" 204 0
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-29 18:37:19 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-29 18:37:19 [auto1.de] INFO: Scrape type for HD83134: 2
2026-03-29 18:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-29 18:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 775d625a-b63d-5158-8a4d-ab299b317418 with scrape type 2
2026-03-29 18:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 775d625a-b63d-5158-8a4d-ab299b317418 with scrape type 2
2026-03-29 18:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 775d625a-b63d-5158-8a4d-ab299b317418, identifier: HD83134
2026-03-29 18:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-29 18:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-29 18:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134 to the API
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:15:34Z',
'fuel_type': 'diesel',
'id': '775d625a-b63d-5158-8a4d-ab299b317418',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD83134',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 127808,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-22',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Feel M',
'transmission': 'automatic',
'trim': 'Feel M',
'year': 2018}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Saving data for HD83134: {'auction_closing_time': 1774883734.0, 'created_time': 1773743753.185873, 'last_price_update_time': 1774809440.236494}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD83134') HTTP/1.1" 204 0
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Scrape type for ZN44804: 2
2026-03-29 18:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-29 18:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b057cf17-7d75-5278-82a8-a956ea96ed8a with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b057cf17-7d75-5278-82a8-a956ea96ed8a with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b057cf17-7d75-5278-82a8-a956ea96ed8a, identifier: ZN44804
2026-03-29 18:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-29 18:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-29 18:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804 to the API
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:37:29Z',
'fuel_type': 'diesel',
'id': 'b057cf17-7d75-5278-82a8-a956ea96ed8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN44804',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 235997,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-09',
'seller_name': None,
'title': 'BMW X5 M50d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Saving data for ZN44804: {'auction_closing_time': 1774885049.0, 'created_time': 1773340684.657667, 'last_price_update_time': 1774809440.803173}
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN44804') HTTP/1.1" 204 0
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28413%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Scrape type for NG28413: 0
2026-03-29 18:37:20 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-29 18:37:20 [auto1.de] INFO: Scrape type for JV68298: 2
2026-03-29 18:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-29 18:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with scrape type 2
2026-03-29 18:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38d0bc1-b543-5df0-ba0f-dd8d970ce090, identifier: JV68298
2026-03-29 18:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-29 18:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-29 18:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298 to the API
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:21:34Z',
'fuel_type': 'diesel',
'id': 'a38d0bc1-b543-5df0-ba0f-dd8d970ce090',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68298',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 271058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-29',
'seller_name': None,
'title': 'Volkswagen Golf VI 2.0 TDI Match',
'transmission': 'automatic',
'trim': 'Match',
'year': 2012}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Saving data for JV68298: {'auction_closing_time': 1774884094.0, 'created_time': 1773861457.989313, 'last_price_update_time': 1774809441.293028}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68298') HTTP/1.1" 204 0
2026-03-29 18:37:21 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Scrape type for JM73266: 2
2026-03-29 18:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-29 18:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aebe9bb2-caa1-56ab-8a0c-652c0810d20a with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aebe9bb2-caa1-56ab-8a0c-652c0810d20a with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aebe9bb2-caa1-56ab-8a0c-652c0810d20a, identifier: JM73266
2026-03-29 18:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-29 18:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-29 18:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266 to the API
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:00:51Z',
'fuel_type': 'diesel',
'id': 'aebe9bb2-caa1-56ab-8a0c-652c0810d20a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM73266',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 278252,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-27',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'manual',
'trim': 'RS',
'year': 2015}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Saving data for JM73266: {'auction_closing_time': 1774882851.0, 'created_time': 1773686258.796828, 'last_price_update_time': 1774809441.752813}
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM73266') HTTP/1.1" 204 0
2026-03-29 18:37:21 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-29 18:37:21 [auto1.de] INFO: Scrape type for SP19687: 2
2026-03-29 18:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-29 18:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96ab93a-d552-5c2c-9238-406f18cf2b9b with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d96ab93a-d552-5c2c-9238-406f18cf2b9b with scrape type 2
2026-03-29 18:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d96ab93a-d552-5c2c-9238-406f18cf2b9b, identifier: SP19687
2026-03-29 18:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-29 18:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-29 18:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687 to the API
2026-03-29 18:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:01:45Z',
'fuel_type': 'petrol',
'id': 'd96ab93a-d552-5c2c-9238-406f18cf2b9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP19687',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 93614,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-17',
'seller_name': None,
'title': 'MINI Clubman Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Saving data for SP19687: {'auction_closing_time': 1774882905.0, 'created_time': 1774608196.173304, 'last_price_update_time': 1774809442.25898}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP19687') HTTP/1.1" 204 0
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for BP33481: 2
2026-03-29 18:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-29 18:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bb0099a-3b0d-50f1-ba1b-750944f050f9, identifier: BP33481
2026-03-29 18:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-29 18:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-29 18:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481 to the API
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:24:38Z',
'fuel_type': 'petrol',
'id': '0bb0099a-3b0d-50f1-ba1b-750944f050f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP33481',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 257051,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-13',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2013}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Saving data for BP33481: {'auction_closing_time': 1774884278.0, 'created_time': 1774607863.392483, 'last_price_update_time': 1774809442.7714}
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP33481') HTTP/1.1" 204 0
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-29 18:37:22 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-29 18:37:22 [auto1.de] INFO: Scrape type for LB09285: 2
2026-03-29 18:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-29 18:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with scrape type 2
2026-03-29 18:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5, identifier: LB09285
2026-03-29 18:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-29 18:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285
2026-03-29 18:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94ff4c94-711f-5ae2-a959-4f29f4edd9c5 with identifier: LB09285 to the API
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:39:44Z',
'fuel_type': 'diesel',
'id': '94ff4c94-711f-5ae2-a959-4f29f4edd9c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB09285',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 147747,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-13',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi GT Line 4WD',
'transmission': 'automatic',
'trim': 'GT Line 4WD',
'year': 2017}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Saving data for LB09285: {'auction_closing_time': 1774885184.0, 'created_time': 1773429571.823721, 'last_price_update_time': 1774809443.237517}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB09285') HTTP/1.1" 204 0
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Scrape type for ME09470: 0
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW45885%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Scrape type for WW45885: 0
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Scrape type for AW26352: 2
2026-03-29 18:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-29 18:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with scrape type 2
2026-03-29 18:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with scrape type 2
2026-03-29 18:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c, identifier: AW26352
2026-03-29 18:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-29 18:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-29 18:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352 to the API
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:44Z',
'fuel_type': 'petrol',
'id': '8697a5a0-d1b7-5856-bfbb-ad5b7515585c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW26352',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 99689,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-12',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
'transmission': 'automatic',
'trim': 'ACT S line',
'year': 2020}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-29 18:37:23 [auto1.de] INFO: Saving data for AW26352: {'auction_closing_time': 1774884284.0, 'created_time': 1773686944.960894, 'last_price_update_time': 1774809443.868699}
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW26352') HTTP/1.1" 204 0
2026-03-29 18:37:23 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-29 18:37:23 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-29 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for RM40239: 2
2026-03-29 18:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-29 18:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649bbf99-953f-5080-840d-6d3ea40eafda with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 649bbf99-953f-5080-840d-6d3ea40eafda with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 649bbf99-953f-5080-840d-6d3ea40eafda, identifier: RM40239
2026-03-29 18:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-29 18:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-29 18:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239 to the API
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:57:36Z',
'fuel_type': 'diesel',
'id': '649bbf99-953f-5080-840d-6d3ea40eafda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM40239',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 251786,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-20',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
'transmission': 'manual',
'trim': 'Standard',
'year': 2012}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Saving data for RM40239: {'auction_closing_time': 1774886256.0, 'created_time': 1773401627.645399, 'last_price_update_time': 1774809444.433498}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM40239') HTTP/1.1" 204 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for GG36618: 2
2026-03-29 18:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-29 18:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2096cefb-abf5-587f-992e-f93d41aa8e65 with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2096cefb-abf5-587f-992e-f93d41aa8e65 with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2096cefb-abf5-587f-992e-f93d41aa8e65, identifier: GG36618
2026-03-29 18:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-29 18:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-29 18:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618 to the API
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:05:13Z',
'fuel_type': 'diesel',
'id': '2096cefb-abf5-587f-992e-f93d41aa8e65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG36618',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 198518,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-10',
'seller_name': None,
'title': 'Seat Ibiza 1.4 TDI Connect',
'transmission': 'manual',
'trim': 'Connect',
'year': 2016}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Saving data for GG36618: {'auction_closing_time': 1774883113.0, 'created_time': 1774262652.68583, 'last_price_update_time': 1774809444.920765}
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG36618') HTTP/1.1" 204 0
2026-03-29 18:37:24 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88490%27 HTTP/1.1" 200 None
2026-03-29 18:37:24 [auto1.de] INFO: Scrape type for JL88490: 2
2026-03-29 18:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490
2026-03-29 18:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a87cd1-5bab-5a01-89c0-c8cd02e170db with scrape type 2
2026-03-29 18:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67a87cd1-5bab-5a01-89c0-c8cd02e170db with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67a87cd1-5bab-5a01-89c0-c8cd02e170db, identifier: JL88490
2026-03-29 18:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490
2026-03-29 18:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490
2026-03-29 18:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67a87cd1-5bab-5a01-89c0-c8cd02e170db with identifier: JL88490 to the API
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:30:03Z',
'fuel_type': 'petrol',
'id': '67a87cd1-5bab-5a01-89c0-c8cd02e170db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL88490',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 163870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-12',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2006}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88490%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Saving data for JL88490: {'auction_closing_time': 1774884603.0, 'created_time': 1774350350.695678, 'last_price_update_time': 1774809445.342396}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL88490') HTTP/1.1" 204 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for BU23510: 2
2026-03-29 18:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-29 18:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13d5bf30-0db6-5a11-bfe6-d6afa666a633, identifier: BU23510
2026-03-29 18:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-29 18:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-29 18:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510 to the API
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:46:28Z',
'fuel_type': 'petrol',
'id': '13d5bf30-0db6-5a11-bfe6-d6afa666a633',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU23510',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 117986,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-15',
'seller_name': None,
'title': 'Opel Adam 1.4 Jam',
'transmission': 'manual',
'trim': 'Jam',
'year': 2014}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Saving data for BU23510: {'auction_closing_time': 1774885588.0, 'created_time': 1773743756.13656, 'last_price_update_time': 1774809445.777658}
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU23510') HTTP/1.1" 204 0
2026-03-29 18:37:25 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-29 18:37:25 [auto1.de] INFO: Scrape type for RE53759: 2
2026-03-29 18:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-29 18:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a6067b-ee3b-5610-a804-62b31a689d9b with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8a6067b-ee3b-5610-a804-62b31a689d9b with scrape type 2
2026-03-29 18:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8a6067b-ee3b-5610-a804-62b31a689d9b, identifier: RE53759
2026-03-29 18:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-29 18:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-29 18:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759 to the API
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:12:37Z',
'fuel_type': 'petrol',
'id': 'b8a6067b-ee3b-5610-a804-62b31a689d9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE53759',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 128859,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-05',
'seller_name': None,
'title': 'Opel Insignia 2.8 V6 Turbo OPC 4x4',
'transmission': 'manual',
'trim': 'OPC 4x4',
'year': 2011}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Saving data for RE53759: {'auction_closing_time': 1774883557.0, 'created_time': 1773945758.684726, 'last_price_update_time': 1774809446.214336}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE53759') HTTP/1.1" 204 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH48180%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for PH48180: 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for NV31897: 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for VW42745: 2
2026-03-29 18:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-29 18:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9697cc-688a-521b-a151-50100d46ec6b with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd9697cc-688a-521b-a151-50100d46ec6b with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd9697cc-688a-521b-a151-50100d46ec6b, identifier: VW42745
2026-03-29 18:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-29 18:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-29 18:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745 to the API
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:30:11Z',
'fuel_type': 'diesel',
'id': 'fd9697cc-688a-521b-a151-50100d46ec6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW42745',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 256460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-02',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'S line Sportpaket plus',
'year': 2014}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Saving data for VW42745: {'auction_closing_time': 1774884611.0, 'created_time': 1773305991.729086, 'last_price_update_time': 1774809446.687513}
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW42745') HTTP/1.1" 204 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW77910%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for PW77910: 0
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-29 18:37:26 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-29 18:37:26 [auto1.de] INFO: Scrape type for TE93454: 2
2026-03-29 18:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-29 18:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with scrape type 2
2026-03-29 18:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead, identifier: TE93454
2026-03-29 18:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-29 18:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-29 18:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454 to the API
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:29:45Z',
'fuel_type': 'petrol',
'id': 'ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE93454',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 106676,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-27',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Saving data for TE93454: {'auction_closing_time': 1774884585.0, 'created_time': 1773687927.697873, 'last_price_update_time': 1774809447.345504}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE93454') HTTP/1.1" 204 0
2026-03-29 18:37:27 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Scrape type for FH45720: 2
2026-03-29 18:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-29 18:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628d424a-e2b7-5244-8333-ca3a03d2c587 with scrape type 2
2026-03-29 18:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 628d424a-e2b7-5244-8333-ca3a03d2c587 with scrape type 2
2026-03-29 18:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 628d424a-e2b7-5244-8333-ca3a03d2c587, identifier: FH45720
2026-03-29 18:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-29 18:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-29 18:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720 to the API
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:14:49Z',
'fuel_type': 'diesel',
'id': '628d424a-e2b7-5244-8333-ca3a03d2c587',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH45720',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 226990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-14',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Team',
'transmission': 'automatic',
'trim': 'Team',
'year': 2010}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Saving data for FH45720: {'auction_closing_time': 1774883689.0, 'created_time': 1774293346.592066, 'last_price_update_time': 1774809447.828597}
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH45720') HTTP/1.1" 204 0
2026-03-29 18:37:27 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Scrape type for MR37276: 0
2026-03-29 18:37:27 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-29 18:37:27 [auto1.de] INFO: Scrape type for PU00921: 2
2026-03-29 18:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-29 18:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with scrape type 2
2026-03-29 18:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with scrape type 2
2026-03-29 18:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2, identifier: PU00921
2026-03-29 18:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-29 18:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-29 18:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921 to the API
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:53:08Z',
'fuel_type': 'diesel',
'id': 'c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU00921',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 156668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-30',
'seller_name': None,
'title': 'Audi A4 40 TDI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2020}
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Saving data for PU00921: {'auction_closing_time': 1774885988.0, 'created_time': 1773302655.443431, 'last_price_update_time': 1774809448.330629}
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU00921') HTTP/1.1" 204 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10648%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for VY10648: 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for UY72197: 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91836%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for FY91836: 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88741%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for PH88741: 0
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-29 18:37:28 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-29 18:37:28 [auto1.de] INFO: Scrape type for VK44645: 2
2026-03-29 18:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-29 18:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa00de5f-a712-5d33-8d4e-b317246fa97a with scrape type 2
2026-03-29 18:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa00de5f-a712-5d33-8d4e-b317246fa97a with scrape type 2
2026-03-29 18:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa00de5f-a712-5d33-8d4e-b317246fa97a, identifier: VK44645
2026-03-29 18:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-29 18:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-29 18:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645 to the API
2026-03-29 18:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:59:35Z',
'fuel_type': 'petrol',
'id': 'fa00de5f-a712-5d33-8d4e-b317246fa97a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK44645',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 199651,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-27',
'seller_name': None,
'title': 'BMW 4er 440i Gran Coupé xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2017}
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-29 18:37:29 [auto1.de] INFO: Saving data for VK44645: {'auction_closing_time': 1774886375.0, 'created_time': 1773686725.472849, 'last_price_update_time': 1774809449.637239}
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK44645') HTTP/1.1" 204 0
2026-03-29 18:37:29 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF07638%27 HTTP/1.1" 200 None
2026-03-29 18:37:29 [auto1.de] INFO: Scrape type for HF07638: 0
2026-03-29 18:37:29 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-29 18:37:29 [auto1.de] INFO: Scrape type for BF26414: 2
2026-03-29 18:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-29 18:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32be1cd-98d0-5a68-bb91-97a0376e72fe with scrape type 2
2026-03-29 18:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e32be1cd-98d0-5a68-bb91-97a0376e72fe with scrape type 2
2026-03-29 18:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e32be1cd-98d0-5a68-bb91-97a0376e72fe, identifier: BF26414
2026-03-29 18:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-29 18:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-29 18:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414 to the API
2026-03-29 18:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:39:11Z',
'fuel_type': 'diesel',
'id': 'e32be1cd-98d0-5a68-bb91-97a0376e72fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF26414',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 140735,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-04',
'seller_name': None,
'title': 'BMW X3 xDrive 20d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Saving data for BF26414: {'auction_closing_time': 1774885151.0, 'created_time': 1773306051.811419, 'last_price_update_time': 1774809450.112957}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF26414') HTTP/1.1" 204 0
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Scrape type for RJ47669: 2
2026-03-29 18:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-29 18:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78100c6e-4e2d-58f3-bcc4-183a44130648 with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78100c6e-4e2d-58f3-bcc4-183a44130648 with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78100c6e-4e2d-58f3-bcc4-183a44130648, identifier: RJ47669
2026-03-29 18:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-29 18:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-29 18:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669 to the API
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:47:30Z',
'fuel_type': 'petrol',
'id': '78100c6e-4e2d-58f3-bcc4-183a44130648',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ47669',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 182184,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-17',
'seller_name': None,
'title': 'Fiat Punto Evo 1.4 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2011}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Saving data for RJ47669: {'auction_closing_time': 1774885650.0, 'created_time': 1773830401.654902, 'last_price_update_time': 1774809450.608197}
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ47669') HTTP/1.1" 204 0
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-29 18:37:30 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-29 18:37:30 [auto1.de] INFO: Scrape type for CF53394: 2
2026-03-29 18:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-29 18:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c9e92d-56fb-5e73-b357-ae329b705d99 with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c9e92d-56fb-5e73-b357-ae329b705d99 with scrape type 2
2026-03-29 18:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c9e92d-56fb-5e73-b357-ae329b705d99, identifier: CF53394
2026-03-29 18:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-29 18:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394
2026-03-29 18:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c9e92d-56fb-5e73-b357-ae329b705d99 with identifier: CF53394 to the API
2026-03-29 18:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:14:09Z',
'fuel_type': 'petrol',
'id': '63c9e92d-56fb-5e73-b357-ae329b705d99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF53394',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 115619,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-16',
'seller_name': None,
'title': 'Ford Focus 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Saving data for CF53394: {'auction_closing_time': 1774883649.0, 'created_time': 1774521597.440524, 'last_price_update_time': 1774809451.357995}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF53394') HTTP/1.1" 204 0
2026-03-29 18:37:31 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55154%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Scrape type for MV55154: 0
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Scrape type for TW15848: 2
2026-03-29 18:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-29 18:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-29 18:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8097b80-dd32-5c15-9311-e37f7ab126b1 with scrape type 2
2026-03-29 18:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8097b80-dd32-5c15-9311-e37f7ab126b1, identifier: TW15848
2026-03-29 18:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-29 18:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848
2026-03-29 18:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8097b80-dd32-5c15-9311-e37f7ab126b1 with identifier: TW15848 to the API
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:31:17Z',
'fuel_type': 'diesel',
'id': 'e8097b80-dd32-5c15-9311-e37f7ab126b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW15848',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 192905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-30',
'seller_name': None,
'title': 'BMW 5er 535d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2012}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Saving data for TW15848: {'auction_closing_time': 1774884677.0, 'created_time': 1774521829.629072, 'last_price_update_time': 1774809451.871146}
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW15848') HTTP/1.1" 204 0
2026-03-29 18:37:31 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-29 18:37:31 [auto1.de] INFO: Scrape type for WZ38880: 2
2026-03-29 18:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-29 18:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363faf73-5150-5013-84e6-228bffc04801 with scrape type 2
2026-03-29 18:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 363faf73-5150-5013-84e6-228bffc04801 with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 363faf73-5150-5013-84e6-228bffc04801, identifier: WZ38880
2026-03-29 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-29 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880
2026-03-29 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 363faf73-5150-5013-84e6-228bffc04801 with identifier: WZ38880 to the API
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:26:54Z',
'fuel_type': 'petrol',
'id': '363faf73-5150-5013-84e6-228bffc04801',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ38880',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 79015,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-29',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI R BlueMotion 4Motion',
'transmission': 'automatic',
'trim': 'R BlueMotion 4Motion',
'year': 2019}
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Saving data for WZ38880: {'auction_closing_time': 1774884414.0, 'created_time': 1774522388.823202, 'last_price_update_time': 1774809452.282151}
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ38880') HTTP/1.1" 204 0
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Scrape type for CZ73559: 2
2026-03-29 18:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-29 18:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e, identifier: CZ73559
2026-03-29 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-29 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-29 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559 to the API
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:20Z',
'fuel_type': 'diesel',
'id': '5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ73559',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 14683,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-02-26',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI Goal',
'transmission': 'automatic',
'trim': 'Goal',
'year': 2025}
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Saving data for CZ73559: {'auction_closing_time': 1774884260.0, 'created_time': 1774034874.647783, 'last_price_update_time': 1774809452.812039}
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ73559') HTTP/1.1" 204 0
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-29 18:37:32 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-29 18:37:32 [auto1.de] INFO: Scrape type for DV41165: 2
2026-03-29 18:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-29 18:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c203b7fd-e636-5306-ad1a-d5d21fa78650 with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c203b7fd-e636-5306-ad1a-d5d21fa78650 with scrape type 2
2026-03-29 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c203b7fd-e636-5306-ad1a-d5d21fa78650, identifier: DV41165
2026-03-29 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-29 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165
2026-03-29 18:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c203b7fd-e636-5306-ad1a-d5d21fa78650 with identifier: DV41165 to the API
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:05:07Z',
'fuel_type': 'petrol',
'id': 'c203b7fd-e636-5306-ad1a-d5d21fa78650',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV41165',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 48581,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-04',
'seller_name': None,
'title': 'Audi TT 2.0 TFSI Roadster',
'transmission': 'manual',
'trim': 'Roadster',
'year': 2007}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Saving data for DV41165: {'auction_closing_time': 1774883107.0, 'created_time': 1774522080.573693, 'last_price_update_time': 1774809453.239036}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV41165') HTTP/1.1" 204 0
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK64805%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Scrape type for AK64805: 0
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Scrape type for GA31373: 2
2026-03-29 18:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-29 18:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61230e02-7fb6-5d7f-9b1d-37da11809044 with scrape type 2
2026-03-29 18:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61230e02-7fb6-5d7f-9b1d-37da11809044 with scrape type 2
2026-03-29 18:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61230e02-7fb6-5d7f-9b1d-37da11809044, identifier: GA31373
2026-03-29 18:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-29 18:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-29 18:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373 to the API
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:01:22Z',
'fuel_type': 'diesel',
'id': '61230e02-7fb6-5d7f-9b1d-37da11809044',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA31373',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 157142,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-24',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Saving data for GA31373: {'auction_closing_time': 1774882882.0, 'created_time': 1773134997.959537, 'last_price_update_time': 1774809453.844599}
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA31373') HTTP/1.1" 204 0
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-29 18:37:33 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-29 18:37:33 [auto1.de] INFO: Scrape type for EP44160: 2
2026-03-29 18:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-29 18:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ad4b93-e9f9-56bd-b711-f05364dacc0e with scrape type 2
2026-03-29 18:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ad4b93-e9f9-56bd-b711-f05364dacc0e with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46ad4b93-e9f9-56bd-b711-f05364dacc0e, identifier: EP44160
2026-03-29 18:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-29 18:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-29 18:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160 to the API
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:24:34Z',
'fuel_type': 'petrol',
'id': '46ad4b93-e9f9-56bd-b711-f05364dacc0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP44160',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 119025,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI IQ.DRIVE',
'transmission': 'manual',
'trim': 'IQ.DRIVE',
'year': 2019}
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Saving data for EP44160: {'auction_closing_time': 1774884274.0, 'created_time': 1773831757.800105, 'last_price_update_time': 1774809454.418624}
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP44160') HTTP/1.1" 204 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC06569%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for TC06569: 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for JC98855: 2
2026-03-29 18:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-29 18:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a, identifier: JC98855
2026-03-29 18:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-29 18:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-29 18:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855 to the API
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:07:24Z',
'fuel_type': 'petrol',
'id': '5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC98855',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 76280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-10',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'manual',
'trim': 'BlueEfficiency Urban',
'year': 2017}
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Saving data for JC98855: {'auction_closing_time': 1774883244.0, 'created_time': 1773383239.787443, 'last_price_update_time': 1774809454.916307}
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC98855') HTTP/1.1" 204 0
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-29 18:37:34 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-29 18:37:34 [auto1.de] INFO: Scrape type for BP97465: 2
2026-03-29 18:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-29 18:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba11a15-316d-56a8-a54d-51082370b945 with scrape type 2
2026-03-29 18:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ba11a15-316d-56a8-a54d-51082370b945 with scrape type 2
2026-03-29 18:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ba11a15-316d-56a8-a54d-51082370b945, identifier: BP97465
2026-03-29 18:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-29 18:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-29 18:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465 to the API
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:53:02Z',
'fuel_type': 'petrol',
'id': '0ba11a15-316d-56a8-a54d-51082370b945',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP97465',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 194329,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-29 18:37:35 [auto1.de] INFO: Saving data for BP97465: {'auction_closing_time': 1774885982.0, 'created_time': 1773303861.074413, 'last_price_update_time': 1774809455.373364}
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP97465') HTTP/1.1" 204 0
2026-03-29 18:37:35 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33543%27 HTTP/1.1" 200 None
2026-03-29 18:37:35 [auto1.de] INFO: Scrape type for TH33543: 2
2026-03-29 18:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543
2026-03-29 18:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with scrape type 2
2026-03-29 18:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with scrape type 2
2026-03-29 18:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f136cace-eadb-5ae7-a3f6-dde8f5af96d5, identifier: TH33543
2026-03-29 18:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 18:37:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543
2026-03-29 18:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f136cace-eadb-5ae7-a3f6-dde8f5af96d5 with identifier: TH33543 to the API
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:47:44Z',
'fuel_type': 'petrol',
'id': 'f136cace-eadb-5ae7-a3f6-dde8f5af96d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH33543',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 156270,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-20',
'seller_name': None,
'title': 'Opel Corsa 1.2 150 Jahre Opel',
'transmission': 'manual',
'trim': '150 Jahre',
'year': 2012}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33543%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Saving data for TH33543: {'auction_closing_time': 1774885664.0, 'created_time': 1773427277.414123, 'last_price_update_time': 1774809456.10708}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH33543') HTTP/1.1" 204 0
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Scrape type for LP44310: 2
2026-03-29 18:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-29 18:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with scrape type 2
2026-03-29 18:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with scrape type 2
2026-03-29 18:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4, identifier: LP44310
2026-03-29 18:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-29 18:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310
2026-03-29 18:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1255ff5-d6df-5a6d-bb47-e7a0ead192d4 with identifier: LP44310 to the API
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:33:46Z',
'fuel_type': 'petrol',
'id': 'e1255ff5-d6df-5a6d-bb47-e7a0ead192d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP44310',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 137678,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-08-17',
'seller_name': None,
'title': 'Ford Fiesta 1.4 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2006}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Saving data for LP44310: {'auction_closing_time': 1774884826.0, 'created_time': 1774521858.018781, 'last_price_update_time': 1774809456.525621}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP44310') HTTP/1.1" 204 0
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL90320%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Scrape type for CL90320: 0
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-29 18:37:36 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Scrape type for LS65332: 2
2026-03-29 18:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-29 18:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with scrape type 2
2026-03-29 18:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with scrape type 2
2026-03-29 18:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f, identifier: LS65332
2026-03-29 18:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-29 18:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332
2026-03-29 18:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fe9947-cd6a-512d-b2d3-1ca5bb936c1f with identifier: LS65332 to the API
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:55:00Z',
'fuel_type': 'petrol',
'id': '47fe9947-cd6a-512d-b2d3-1ca5bb936c1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS65332',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Vitara',
'odometer': 93833,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-05',
'seller_name': None,
'title': 'Suzuki Vitara 1.6 Comfort 4x2',
'transmission': 'manual',
'trim': 'Comfort 4x2',
'year': 2017}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-29 18:37:36 [auto1.de] INFO: Saving data for LS65332: {'auction_closing_time': 1774886100.0, 'created_time': 1774522154.803756, 'last_price_update_time': 1774809456.941468}
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS65332') HTTP/1.1" 204 0
2026-03-29 18:37:37 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-29 18:37:37 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-29 18:37:37 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Scrape type for ND38532: 2
2026-03-29 18:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-29 18:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bfe349-cf26-5853-9df2-e562fedd2daf with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58bfe349-cf26-5853-9df2-e562fedd2daf with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58bfe349-cf26-5853-9df2-e562fedd2daf, identifier: ND38532
2026-03-29 18:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-29 18:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-29 18:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532 to the API
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 390,
'expiration_date': '2026-03-30T15:06:27Z',
'fuel_type': 'petrol',
'id': '58bfe349-cf26-5853-9df2-e562fedd2daf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND38532',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 85127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-01',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Saving data for ND38532: {'auction_closing_time': 1774883187.0, 'created_time': 1773307455.171278, 'last_price_update_time': 1774809457.475651}
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND38532') HTTP/1.1" 204 0
2026-03-29 18:37:37 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-29 18:37:37 [auto1.de] INFO: Scrape type for PL79897: 2
2026-03-29 18:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-29 18:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with scrape type 2
2026-03-29 18:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbb187ba-a4f7-5da6-991d-f766bc2c40f5, identifier: PL79897
2026-03-29 18:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-29 18:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-29 18:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897 to the API
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:47:24Z',
'fuel_type': 'petrol',
'id': 'dbb187ba-a4f7-5da6-991d-f766bc2c40f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL79897',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 25279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-28',
'seller_name': None,
'title': 'Citroen C4 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2023}
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-29 18:37:38 [auto1.de] INFO: Saving data for PL79897: {'auction_closing_time': 1774885644.0, 'created_time': 1774293908.438891, 'last_price_update_time': 1774809458.032277}
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL79897') HTTP/1.1" 204 0
2026-03-29 18:37:38 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-29 18:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:43 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: US43373
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US43373%27 HTTP/1.1" 200 None
2026-03-29 18:37:43 [auto1.de] INFO: Scrape type for US43373: 0
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-29 18:37:43 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-29 18:37:43 [auto1.de] INFO: Scrape type for PW65541: 2
2026-03-29 18:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-29 18:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c019c7-4d81-59ad-8739-7977ca54f042 with scrape type 2
2026-03-29 18:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6c019c7-4d81-59ad-8739-7977ca54f042 with scrape type 2
2026-03-29 18:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6c019c7-4d81-59ad-8739-7977ca54f042, identifier: PW65541
2026-03-29 18:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-29 18:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-29 18:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541 to the API
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:56:59Z',
'fuel_type': 'diesel',
'id': 'a6c019c7-4d81-59ad-8739-7977ca54f042',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW65541',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 329772,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-25',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2012}
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-29 18:37:43 [auto1.de] INFO: Saving data for PW65541: {'auction_closing_time': 1774886219.0, 'created_time': 1774265294.143686, 'last_price_update_time': 1774809463.946036}
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW65541') HTTP/1.1" 204 0
2026-03-29 18:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:44 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-29 18:37:44 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-29 18:37:44 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98956%27 HTTP/1.1" 200 None
2026-03-29 18:37:44 [auto1.de] INFO: Scrape type for VV98956: 0
2026-03-29 18:37:44 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-29 18:37:44 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-29 18:37:44 [auto1.de] INFO: Scrape type for CS48399: 2
2026-03-29 18:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-29 18:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 507b67bd-ce04-58e7-80ac-0ce91872a85c with scrape type 2
2026-03-29 18:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 507b67bd-ce04-58e7-80ac-0ce91872a85c with scrape type 2
2026-03-29 18:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 507b67bd-ce04-58e7-80ac-0ce91872a85c, identifier: CS48399
2026-03-29 18:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-29 18:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-29 18:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399 to the API
2026-03-29 18:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 207,
'expiration_date': '2026-03-30T15:52:28Z',
'fuel_type': 'petrol',
'id': '507b67bd-ce04-58e7-80ac-0ce91872a85c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS48399',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 69908,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-11',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2022}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Saving data for CS48399: {'auction_closing_time': 1774885948.0, 'created_time': 1773382503.097293, 'last_price_update_time': 1774809466.070829}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS48399') HTTP/1.1" 204 0
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Scrape type for HY33546: 2
2026-03-29 18:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-29 18:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d11637e-f70c-5c62-8b36-ea3a54712054 with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d11637e-f70c-5c62-8b36-ea3a54712054 with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d11637e-f70c-5c62-8b36-ea3a54712054, identifier: HY33546
2026-03-29 18:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-29 18:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-29 18:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546 to the API
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:28:30Z',
'fuel_type': 'diesel',
'id': '1d11637e-f70c-5c62-8b36-ea3a54712054',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY33546',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 308129,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-14',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.5 TDI Startline',
'transmission': 'manual',
'trim': 'Startline',
'year': 2010}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Saving data for HY33546: {'auction_closing_time': 1774884510.0, 'created_time': 1773858962.114718, 'last_price_update_time': 1774809466.520514}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY33546') HTTP/1.1" 204 0
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Scrape type for XP82440: 2
2026-03-29 18:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-29 18:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7b782c-915a-5365-a586-e64e133b1eac with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e7b782c-915a-5365-a586-e64e133b1eac with scrape type 2
2026-03-29 18:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e7b782c-915a-5365-a586-e64e133b1eac, identifier: XP82440
2026-03-29 18:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-29 18:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-29 18:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440 to the API
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:53:11Z',
'fuel_type': 'petrol',
'id': '4e7b782c-915a-5365-a586-e64e133b1eac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP82440',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 73340,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-19',
'seller_name': None,
'title': 'Cupra Formentor 1.5 TSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-29 18:37:46 [auto1.de] INFO: Saving data for XP82440: {'auction_closing_time': 1774885991.0, 'created_time': 1773138533.799474, 'last_price_update_time': 1774809466.975441}
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP82440') HTTP/1.1" 204 0
2026-03-29 18:37:46 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Scrape type for FM08350: 2
2026-03-29 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-29 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8, identifier: FM08350
2026-03-29 18:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-29 18:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-29 18:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350 to the API
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:18Z',
'fuel_type': 'petrol',
'id': 'b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM08350',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 123104,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-26',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Saving data for FM08350: {'auction_closing_time': 1774884858.0, 'created_time': 1773859217.239419, 'last_price_update_time': 1774809467.409254}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM08350') HTTP/1.1" 204 0
2026-03-29 18:37:47 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77212%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Scrape type for PF77212: 0
2026-03-29 18:37:47 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Scrape type for WZ92700: 2
2026-03-29 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-29 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with scrape type 2
2026-03-29 18:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d, identifier: WZ92700
2026-03-29 18:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-29 18:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-29 18:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700 to the API
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:04:52Z',
'fuel_type': 'petrol',
'id': '9a0b7c11-2db7-5c80-8844-a0215f1ea09d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ92700',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 149302,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-04',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2018}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-29 18:37:47 [auto1.de] INFO: Saving data for WZ92700: {'auction_closing_time': 1774883092.0, 'created_time': 1773131998.002393, 'last_price_update_time': 1774809467.909577}
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ92700') HTTP/1.1" 204 0
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Scrape type for BJ29098: 0
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN28121%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Scrape type for NN28121: 0
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Scrape type for PA80529: 2
2026-03-29 18:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-29 18:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with scrape type 2
2026-03-29 18:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with scrape type 2
2026-03-29 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1, identifier: PA80529
2026-03-29 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-29 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529
2026-03-29 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b7b4436-b416-58bd-b4d1-2ec5f70e65e1 with identifier: PA80529 to the API
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:59:51Z',
'fuel_type': 'petrol',
'id': '0b7b4436-b416-58bd-b4d1-2ec5f70e65e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA80529',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 113105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-06',
'seller_name': None,
'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
'transmission': 'manual',
'trim': 'Edition "111 Jahre"',
'year': 2010}
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Saving data for PA80529: {'auction_closing_time': 1774886391.0, 'created_time': 1773429674.845522, 'last_price_update_time': 1774809468.506949}
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA80529') HTTP/1.1" 204 0
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-29 18:37:48 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-29 18:37:48 [auto1.de] INFO: Scrape type for FD93722: 2
2026-03-29 18:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-29 18:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667e67f9-2345-593f-8877-e7b6129f7d00 with scrape type 2
2026-03-29 18:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667e67f9-2345-593f-8877-e7b6129f7d00 with scrape type 2
2026-03-29 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667e67f9-2345-593f-8877-e7b6129f7d00, identifier: FD93722
2026-03-29 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-29 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722
2026-03-29 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667e67f9-2345-593f-8877-e7b6129f7d00 with identifier: FD93722 to the API
2026-03-29 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:48:38Z',
'fuel_type': 'petrol',
'id': '667e67f9-2345-593f-8877-e7b6129f7d00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD93722',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 153238,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-26',
'seller_name': None,
'title': 'BMW 1er 118i Edition M Sport Shadow',
'transmission': 'automatic',
'trim': 'Edition M Sport Shadow',
'year': 2017}
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-29 18:37:49 [auto1.de] INFO: Saving data for FD93722: {'auction_closing_time': 1774885718.0, 'created_time': 1774119122.962841, 'last_price_update_time': 1774809469.506944}
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD93722') HTTP/1.1" 204 0
2026-03-29 18:37:49 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-29 18:37:49 [auto1.de] INFO: Scrape type for ZU03053: 2
2026-03-29 18:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-29 18:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 665825aa-3344-5885-a048-7d3ebcfaa2f8 with scrape type 2
2026-03-29 18:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 665825aa-3344-5885-a048-7d3ebcfaa2f8 with scrape type 2
2026-03-29 18:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 665825aa-3344-5885-a048-7d3ebcfaa2f8, identifier: ZU03053
2026-03-29 18:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-29 18:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-29 18:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053 to the API
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:20:46Z',
'fuel_type': 'petrol',
'id': '665825aa-3344-5885-a048-7d3ebcfaa2f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU03053',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 123084,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-31',
'seller_name': None,
'title': 'Seat Ibiza 1.0 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-29 18:37:49 [auto1.de] INFO: Saving data for ZU03053: {'auction_closing_time': 1774884046.0, 'created_time': 1774290985.241422, 'last_price_update_time': 1774809469.984116}
2026-03-29 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU03053') HTTP/1.1" 204 0
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Scrape type for WG69866: 2
2026-03-29 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-29 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12cb2a1-a2fe-534d-b4fb-81d35620c92c with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12cb2a1-a2fe-534d-b4fb-81d35620c92c with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12cb2a1-a2fe-534d-b4fb-81d35620c92c, identifier: WG69866
2026-03-29 18:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-29 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-29 18:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866 to the API
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:32Z',
'fuel_type': 'diesel',
'id': 'e12cb2a1-a2fe-534d-b4fb-81d35620c92c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG69866',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 114723,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-31',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Saving data for WG69866: {'auction_closing_time': 1774883252.0, 'created_time': 1773688809.985888, 'last_price_update_time': 1774809470.49793}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG69866') HTTP/1.1" 204 0
2026-03-29 18:37:50 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Scrape type for RD35105: 2
2026-03-29 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-29 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4cd017-9eb1-5923-8313-23b0ba090ccd with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4cd017-9eb1-5923-8313-23b0ba090ccd with scrape type 2
2026-03-29 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f4cd017-9eb1-5923-8313-23b0ba090ccd, identifier: RD35105
2026-03-29 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-29 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105
2026-03-29 18:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f4cd017-9eb1-5923-8313-23b0ba090ccd with identifier: RD35105 to the API
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:03:23Z',
'fuel_type': 'petrol',
'id': '1f4cd017-9eb1-5923-8313-23b0ba090ccd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD35105',
'listing': 'auction',
'make': 'Abarth',
'model': '595C',
'odometer': 70202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-26',
'seller_name': None,
'title': 'Abarth 595C 1.4 Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2014}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-29 18:37:50 [auto1.de] INFO: Saving data for RD35105: {'auction_closing_time': 1774883003.0, 'created_time': 1774521700.736752, 'last_price_update_time': 1774809470.893104}
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD35105') HTTP/1.1" 204 0
2026-03-29 18:37:51 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-29 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-29 18:37:51 [auto1.de] INFO: Scrape type for ZV21910: 2
2026-03-29 18:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-29 18:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e2149d-fd64-58e9-9a74-281aee60537d with scrape type 2
2026-03-29 18:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e2149d-fd64-58e9-9a74-281aee60537d with scrape type 2
2026-03-29 18:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4e2149d-fd64-58e9-9a74-281aee60537d, identifier: ZV21910
2026-03-29 18:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-29 18:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-29 18:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910 to the API
2026-03-29 18:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:42:02Z',
'fuel_type': 'diesel',
'id': 'b4e2149d-fd64-58e9-9a74-281aee60537d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV21910',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Santa Fe',
'odometer': 187457,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-01',
'seller_name': None,
'title': 'Hyundai Santa Fe 2.2 CRDi Premium 4WD',
'transmission': 'automatic',
'trim': 'Premium 4WD',
'year': 2016}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Saving data for ZV21910: {'auction_closing_time': 1774885322.0, 'created_time': 1773387352.387303, 'last_price_update_time': 1774809472.077708}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV21910') HTTP/1.1" 204 0
2026-03-29 18:37:52 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for BA65327: 2
2026-03-29 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-29 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08039476-1e58-55bc-a729-5d8e6e59965d with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08039476-1e58-55bc-a729-5d8e6e59965d with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08039476-1e58-55bc-a729-5d8e6e59965d, identifier: BA65327
2026-03-29 18:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-29 18:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-29 18:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327 to the API
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:31:11Z',
'fuel_type': 'petrol',
'id': '08039476-1e58-55bc-a729-5d8e6e59965d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA65327',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 326138,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-21',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Saving data for BA65327: {'auction_closing_time': 1774884671.0, 'created_time': 1773861427.078271, 'last_price_update_time': 1774809472.538836}
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA65327') HTTP/1.1" 204 0
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA56984%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for TA56984: 0
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17953%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for CS17953: 0
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH53134%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for BH53134: 0
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for VJ38627: 2
2026-03-29 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-29 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a, identifier: VJ38627
2026-03-29 18:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72681%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for SJ72681: 0
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-29 18:37:52 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-29 18:37:52 [auto1.de] INFO: Scrape type for GW52920: 2
2026-03-29 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-29 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with scrape type 2
2026-03-29 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15, identifier: GW52920
2026-03-29 18:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-29 18:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-29 18:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627 to the API
2026-03-29 18:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:58:37Z',
'fuel_type': 'hybrid',
'id': '00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ38627',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 161252,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-02',
'seller_name': None,
'title': 'Audi Q5 50 TFSIe quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Saving data for VJ38627: {'auction_closing_time': 1774886317.0, 'created_time': 1773772524.461254, 'last_price_update_time': 1774809473.192533}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ38627') HTTP/1.1" 204 0
2026-03-29 18:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-29 18:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-29 18:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920 to the API
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:06:39Z',
'fuel_type': 'diesel',
'id': '7d4df8ba-03b5-5cec-ade7-dfc338b21c15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW52920',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 86205,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-15',
'seller_name': None,
'title': 'BMW 3er 320d GT xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Saving data for GW52920: {'auction_closing_time': 1774883199.0, 'created_time': 1774294780.198223, 'last_price_update_time': 1774809473.691219}
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW52920') HTTP/1.1" 204 0
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Scrape type for WK71622: 2
2026-03-29 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-29 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73de4cc-bcff-56d8-9b06-21e32eb0beee with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a73de4cc-bcff-56d8-9b06-21e32eb0beee with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a73de4cc-bcff-56d8-9b06-21e32eb0beee, identifier: WK71622
2026-03-29 18:37:53 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-29 18:37:53 [auto1.de] INFO: Scrape type for KS48100: 2
2026-03-29 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100
2026-03-29 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d002de-27ad-5867-8e62-144a3fca40bb with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15d002de-27ad-5867-8e62-144a3fca40bb with scrape type 2
2026-03-29 18:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15d002de-27ad-5867-8e62-144a3fca40bb, identifier: KS48100
2026-03-29 18:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-29 18:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-29 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622 to the API
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:03:19Z',
'fuel_type': 'diesel',
'id': 'a73de4cc-bcff-56d8-9b06-21e32eb0beee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK71622',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 169073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-26',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Saving data for WK71622: {'auction_closing_time': 1774882999.0, 'created_time': 1773830234.05917, 'last_price_update_time': 1774809474.281015}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK71622') HTTP/1.1" 204 0
2026-03-29 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100
2026-03-29 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100
2026-03-29 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100 to the API
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:08:17Z',
'fuel_type': 'petrol',
'id': '15d002de-27ad-5867-8e62-144a3fca40bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS48100',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 30291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-13',
'seller_name': None,
'title': 'MINI Cooper S Favoured Trim',
'transmission': 'automatic',
'trim': 'Favoured Trim',
'year': 2024}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Saving data for KS48100: {'auction_closing_time': 1774883297.0, 'created_time': 1774510545.457493, 'last_price_update_time': 1774809474.643996}
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS48100') HTTP/1.1" 204 0
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Scrape type for XP46424: 2
2026-03-29 18:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-29 18:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fa0a3de-1deb-55a6-8945-192640326273 with scrape type 2
2026-03-29 18:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fa0a3de-1deb-55a6-8945-192640326273 with scrape type 2
2026-03-29 18:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fa0a3de-1deb-55a6-8945-192640326273, identifier: XP46424
2026-03-29 18:37:54 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-29 18:37:54 [auto1.de] INFO: Scrape type for SX14499: 2
2026-03-29 18:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-29 18:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with scrape type 2
2026-03-29 18:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with scrape type 2
2026-03-29 18:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb, identifier: SX14499
2026-03-29 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-29 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424
2026-03-29 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fa0a3de-1deb-55a6-8945-192640326273 with identifier: XP46424 to the API
2026-03-29 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:35:51Z',
'fuel_type': 'petrol',
'id': '6fa0a3de-1deb-55a6-8945-192640326273',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP46424',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 257574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-02',
'seller_name': None,
'title': 'Skoda Yeti 1.2 TSI Active Plus Edition',
'transmission': 'manual',
'trim': 'Active Plus Edition',
'year': 2012}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Saving data for XP46424: {'auction_closing_time': 1774884951.0, 'created_time': 1774522233.907532, 'last_price_update_time': 1774809475.180182}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP46424') HTTP/1.1" 204 0
2026-03-29 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-29 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-29 18:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499 to the API
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:58:40Z',
'fuel_type': 'petrol',
'id': '6da77647-6a9b-52f4-bdb9-d629b3ec6bbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX14499',
'listing': 'auction',
'make': 'Ford',
'model': 'Puma',
'odometer': 47609,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-11',
'seller_name': None,
'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2021}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Saving data for SX14499: {'auction_closing_time': 1774886320.0, 'created_time': 1773383209.397009, 'last_price_update_time': 1774809475.518946}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX14499') HTTP/1.1" 204 0
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Scrape type for TY49191: 2
2026-03-29 18:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-29 18:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f2b5721-2072-52e6-b19a-ea3eafd23440 with scrape type 2
2026-03-29 18:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f2b5721-2072-52e6-b19a-ea3eafd23440 with scrape type 2
2026-03-29 18:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f2b5721-2072-52e6-b19a-ea3eafd23440, identifier: TY49191
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC04825%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Scrape type for ZC04825: 0
2026-03-29 18:37:55 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-29 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-29 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191
2026-03-29 18:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f2b5721-2072-52e6-b19a-ea3eafd23440 with identifier: TY49191 to the API
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:03:42Z',
'fuel_type': 'diesel',
'id': '8f2b5721-2072-52e6-b19a-ea3eafd23440',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY49191',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 116897,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-04',
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2019}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-29 18:37:55 [auto1.de] INFO: Saving data for TY49191: {'auction_closing_time': 1774883022.0, 'created_time': 1774522553.177865, 'last_price_update_time': 1774809475.987828}
2026-03-29 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY49191') HTTP/1.1" 204 0
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Scrape type for UH96912: 2
2026-03-29 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-29 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58218d58-2d0b-52a0-a29d-2a6dffef178a with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58218d58-2d0b-52a0-a29d-2a6dffef178a with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58218d58-2d0b-52a0-a29d-2a6dffef178a, identifier: UH96912
2026-03-29 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-29 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-29 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912 to the API
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 387,
'expiration_date': '2026-03-30T15:47:01Z',
'fuel_type': 'petrol',
'id': '58218d58-2d0b-52a0-a29d-2a6dffef178a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH96912',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 164074,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-07',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 500 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2009}
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Saving data for UH96912: {'auction_closing_time': 1774885621.0, 'created_time': 1773134152.576679, 'last_price_update_time': 1774809476.550617}
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH96912') HTTP/1.1" 204 0
2026-03-29 18:37:56 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-29 18:37:56 [auto1.de] INFO: Scrape type for MY92722: 2
2026-03-29 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-29 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa7f59e-3138-5b9a-b132-35704fa2c10d with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caa7f59e-3138-5b9a-b132-35704fa2c10d with scrape type 2
2026-03-29 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caa7f59e-3138-5b9a-b132-35704fa2c10d, identifier: MY92722
2026-03-29 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-29 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-29 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722 to the API
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:57:21Z',
'fuel_type': 'diesel',
'id': 'caa7f59e-3138-5b9a-b132-35704fa2c10d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY92722',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 223823,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-09',
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Saving data for MY92722: {'auction_closing_time': 1774886241.0, 'created_time': 1774608191.339699, 'last_price_update_time': 1774809477.036314}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY92722') HTTP/1.1" 204 0
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Scrape type for HV25811: 2
2026-03-29 18:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-29 18:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67d37d4-9e1d-59fb-be68-efdf59c28486 with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67d37d4-9e1d-59fb-be68-efdf59c28486 with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a67d37d4-9e1d-59fb-be68-efdf59c28486, identifier: HV25811
2026-03-29 18:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-29 18:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-29 18:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811 to the API
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:57:18Z',
'fuel_type': 'diesel',
'id': 'a67d37d4-9e1d-59fb-be68-efdf59c28486',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV25811',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 194886,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-10',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2014}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Saving data for HV25811: {'auction_closing_time': 1774886238.0, 'created_time': 1773861037.372869, 'last_price_update_time': 1774809477.487711}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV25811') HTTP/1.1" 204 0
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-29 18:37:57 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Scrape type for UH00039: 2
2026-03-29 18:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-29 18:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with scrape type 2
2026-03-29 18:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e, identifier: UH00039
2026-03-29 18:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-29 18:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-29 18:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039 to the API
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:31:44Z',
'fuel_type': 'petrol',
'id': '66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH00039',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo',
'odometer': 139195,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'Ford Tourneo 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-29 18:37:57 [auto1.de] INFO: Saving data for UH00039: {'auction_closing_time': 1774884704.0, 'created_time': 1773858927.548276, 'last_price_update_time': 1774809477.935713}
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH00039') HTTP/1.1" 204 0
2026-03-29 18:37:58 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Scrape type for GA28860: 2
2026-03-29 18:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-29 18:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab1ca00-fb3f-5739-8785-2c59c1349aa6 with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab1ca00-fb3f-5739-8785-2c59c1349aa6 with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab1ca00-fb3f-5739-8785-2c59c1349aa6, identifier: GA28860
2026-03-29 18:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-29 18:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-29 18:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860 to the API
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:21:41Z',
'fuel_type': 'diesel',
'id': 'dab1ca00-fb3f-5739-8785-2c59c1349aa6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA28860',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Grand Sport',
'odometer': 186474,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-19',
'seller_name': None,
'title': 'Opel Insignia Grand Sport 2.0 CDTI Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2019}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Saving data for GA28860: {'auction_closing_time': 1774884101.0, 'created_time': 1773775730.393811, 'last_price_update_time': 1774809478.503615}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA28860') HTTP/1.1" 204 0
2026-03-29 18:37:58 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG25993%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Scrape type for HG25993: 0
2026-03-29 18:37:58 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Scrape type for UF45337: 2
2026-03-29 18:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-29 18:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849444f1-0b58-52fc-9dd5-7e9570ffec46 with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 849444f1-0b58-52fc-9dd5-7e9570ffec46 with scrape type 2
2026-03-29 18:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 849444f1-0b58-52fc-9dd5-7e9570ffec46, identifier: UF45337
2026-03-29 18:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-29 18:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-29 18:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337 to the API
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 167,
'expiration_date': '2026-03-30T15:56:58Z',
'fuel_type': 'petrol',
'id': '849444f1-0b58-52fc-9dd5-7e9570ffec46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF45337',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Coupe',
'odometer': 160218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-25',
'seller_name': None,
'title': 'Hyundai Coupe 2.7 V6 GLS',
'transmission': 'automatic',
'trim': 'GLS',
'year': 2006}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-29 18:37:58 [auto1.de] INFO: Saving data for UF45337: {'auction_closing_time': 1774886218.0, 'created_time': 1773306921.670261, 'last_price_update_time': 1774809478.975564}
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF45337') HTTP/1.1" 204 0
2026-03-29 18:37:58 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 6740 | hits on page: 40
2026-03-29 18:37:58 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for JH35819: 2
2026-03-29 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-29 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c0106e-330b-52a8-849a-e224554552db with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c0106e-330b-52a8-849a-e224554552db with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c0106e-330b-52a8-849a-e224554552db, identifier: JH35819
2026-03-29 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-29 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-29 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819 to the API
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:14:02Z',
'fuel_type': 'petrol',
'id': '66c0106e-330b-52a8-849a-e224554552db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH35819',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 115436,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-27',
'seller_name': None,
'title': 'BMW 1er 116i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2017}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Saving data for JH35819: {'auction_closing_time': 1774883642.0, 'created_time': 1773773156.4411, 'last_price_update_time': 1774809479.437255}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH35819') HTTP/1.1" 204 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for LB66833: 2
2026-03-29 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-29 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6be496-8bbe-51da-98a3-28cae4b041ab with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a6be496-8bbe-51da-98a3-28cae4b041ab with scrape type 2
2026-03-29 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6be496-8bbe-51da-98a3-28cae4b041ab, identifier: LB66833
2026-03-29 18:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for RF22787: 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR95726%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for PR95726: 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Scrape type for HM43288: 0
2026-03-29 18:37:59 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-29 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-29 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-29 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833 to the API
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:01:47Z',
'fuel_type': 'petrol',
'id': '8a6be496-8bbe-51da-98a3-28cae4b041ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB66833',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 37838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-13',
'seller_name': None,
'title': 'Renault Captur 1.0 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2020}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-29 18:37:59 [auto1.de] INFO: Saving data for LB66833: {'auction_closing_time': 1774882907.0, 'created_time': 1773772561.424565, 'last_price_update_time': 1774809479.924654}
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB66833') HTTP/1.1" 204 0
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ12111%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Scrape type for BZ12111: 0
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Scrape type for MG70959: 2
2026-03-29 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-29 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82, identifier: MG70959
2026-03-29 18:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-29 18:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-29 18:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959 to the API
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:12:01Z',
'fuel_type': 'petrol',
'id': '1650e1ec-9f27-5960-8d16-69c8bdbe0c82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG70959',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 247311,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-14',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Saving data for MG70959: {'auction_closing_time': 1774883521.0, 'created_time': 1773380530.636258, 'last_price_update_time': 1774809480.531329}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG70959') HTTP/1.1" 204 0
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28924%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Scrape type for ZF28924: 0
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Scrape type for DJ14237: 2
2026-03-29 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237
2026-03-29 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b72472a-09ec-5538-8394-2400d67a0d06 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b72472a-09ec-5538-8394-2400d67a0d06 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b72472a-09ec-5538-8394-2400d67a0d06, identifier: DJ14237
2026-03-29 18:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237
2026-03-29 18:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237
2026-03-29 18:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b72472a-09ec-5538-8394-2400d67a0d06 with identifier: DJ14237 to the API
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:14:39Z',
'fuel_type': 'petrol',
'id': '7b72472a-09ec-5538-8394-2400d67a0d06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ14237',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 131630,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2019}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Saving data for DJ14237: {'auction_closing_time': 1774883679.0, 'created_time': 1774636529.649199, 'last_price_update_time': 1774809480.946681}
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ14237') HTTP/1.1" 204 0
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-29 18:38:00 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-29 18:38:00 [auto1.de] INFO: Scrape type for LN88860: 2
2026-03-29 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-29 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with scrape type 2
2026-03-29 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with scrape type 2
2026-03-29 18:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9, identifier: LN88860
2026-03-29 18:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-29 18:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-29 18:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860 to the API
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 354,
'expiration_date': '2026-03-30T15:32:33Z',
'fuel_type': 'petrol',
'id': '9e0969dd-d8b2-56e7-ac64-2adf09551dd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN88860',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 129255,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-15',
'seller_name': None,
'title': 'BMW X3 M40i',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Saving data for LN88860: {'auction_closing_time': 1774884753.0, 'created_time': 1773303519.535343, 'last_price_update_time': 1774809481.405784}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN88860') HTTP/1.1" 204 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN01043%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for VN01043: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for EV58982: 2
2026-03-29 18:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982
2026-03-29 18:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f041308b-b69d-588e-a783-26d901994d59 with scrape type 2
2026-03-29 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f041308b-b69d-588e-a783-26d901994d59 with scrape type 2
2026-03-29 18:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f041308b-b69d-588e-a783-26d901994d59, identifier: EV58982
2026-03-29 18:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982
2026-03-29 18:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982
2026-03-29 18:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f041308b-b69d-588e-a783-26d901994d59 with identifier: EV58982 to the API
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:41:54Z',
'fuel_type': 'diesel',
'id': 'f041308b-b69d-588e-a783-26d901994d59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV58982',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 277114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-15',
'seller_name': None,
'title': 'Volkswagen Golf V 2.0 TDI Sportline',
'transmission': 'manual',
'trim': 'Sportline',
'year': 2005}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Saving data for EV58982: {'auction_closing_time': 1774885314.0, 'created_time': 1772543116.931886, 'last_price_update_time': 1774809481.944557}
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV58982') HTTP/1.1" 204 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-29 18:38:01 [auto1.de] INFO: Scrape type for PN56757: 0
2026-03-29 18:38:01 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-29 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ54145%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Scrape type for PJ54145: 0
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH75769%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Scrape type for CH75769: 0
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Scrape type for NY21217: 2
2026-03-29 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-29 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5354c06-711e-5a00-aef7-3de8a7d627d6 with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5354c06-711e-5a00-aef7-3de8a7d627d6 with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5354c06-711e-5a00-aef7-3de8a7d627d6, identifier: NY21217
2026-03-29 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-29 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217
2026-03-29 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5354c06-711e-5a00-aef7-3de8a7d627d6 with identifier: NY21217 to the API
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 330,
'expiration_date': '2026-03-30T15:07:26Z',
'fuel_type': 'diesel',
'id': 'c5354c06-711e-5a00-aef7-3de8a7d627d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY21217',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 131661,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-25',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2021}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Saving data for NY21217: {'auction_closing_time': 1774883246.0, 'created_time': 1774521415.441809, 'last_price_update_time': 1774809482.472324}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY21217') HTTP/1.1" 204 0
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-29 18:38:02 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Scrape type for ZV61779: 2
2026-03-29 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-29 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1a7600-ef21-5d70-8567-de4d1cedd691 with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1a7600-ef21-5d70-8567-de4d1cedd691 with scrape type 2
2026-03-29 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c1a7600-ef21-5d70-8567-de4d1cedd691, identifier: ZV61779
2026-03-29 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-29 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-29 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779 to the API
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:11:04Z',
'fuel_type': 'petrol',
'id': '4c1a7600-ef21-5d70-8567-de4d1cedd691',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV61779',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLS-Klasse',
'odometer': 133452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-11',
'seller_name': None,
'title': 'Mercedes-Benz CLS-Klasse CLS 400 CGI Shooting Brake 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2017}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-29 18:38:02 [auto1.de] INFO: Saving data for ZV61779: {'auction_closing_time': 1774883464.0, 'created_time': 1774291071.471659, 'last_price_update_time': 1774809482.923822}
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV61779') HTTP/1.1" 204 0
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-29 18:38:03 [auto1.de] INFO: Scrape type for BH48904: 2
2026-03-29 18:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-29 18:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d265f54-893f-5175-a7fa-5e2db4b057f9 with scrape type 2
2026-03-29 18:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d265f54-893f-5175-a7fa-5e2db4b057f9 with scrape type 2
2026-03-29 18:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d265f54-893f-5175-a7fa-5e2db4b057f9, identifier: BH48904
2026-03-29 18:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-29 18:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-29 18:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904 to the API
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:26:37Z',
'fuel_type': 'petrol',
'id': '3d265f54-893f-5175-a7fa-5e2db4b057f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH48904',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 135257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-15',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-29 18:38:03 [auto1.de] INFO: Saving data for BH48904: {'auction_closing_time': 1774884397.0, 'created_time': 1773429304.492301, 'last_price_update_time': 1774809483.474397}
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH48904') HTTP/1.1" 204 0
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM02183%27 HTTP/1.1" 200 None
2026-03-29 18:38:03 [auto1.de] INFO: Scrape type for YM02183: 0
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-29 18:38:03 [auto1.de] INFO: Scrape type for TZ67975: 0
2026-03-29 18:38:03 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-29 18:38:03 [auto1.de] INFO: Scrape type for AE20511: 2
2026-03-29 18:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-29 18:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434b8019-9dbb-5bd8-bdee-ea8338802c1f with scrape type 2
2026-03-29 18:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434b8019-9dbb-5bd8-bdee-ea8338802c1f with scrape type 2
2026-03-29 18:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 434b8019-9dbb-5bd8-bdee-ea8338802c1f, identifier: AE20511
2026-03-29 18:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-29 18:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-29 18:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511 to the API
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:29:50Z',
'fuel_type': 'petrol',
'id': '434b8019-9dbb-5bd8-bdee-ea8338802c1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE20511',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 79526,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-13',
'seller_name': None,
'title': 'Fiat Panda 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Saving data for AE20511: {'auction_closing_time': 1774884590.0, 'created_time': 1774608551.404671, 'last_price_update_time': 1774809484.013184}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE20511') HTTP/1.1" 204 0
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Scrape type for PF14640: 2
2026-03-29 18:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-29 18:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a4f48d8-75d2-53b5-8676-10b07587cd4e with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a4f48d8-75d2-53b5-8676-10b07587cd4e with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a4f48d8-75d2-53b5-8676-10b07587cd4e, identifier: PF14640
2026-03-29 18:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-29 18:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640
2026-03-29 18:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a4f48d8-75d2-53b5-8676-10b07587cd4e with identifier: PF14640 to the API
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:08:54Z',
'fuel_type': 'petrol',
'id': '6a4f48d8-75d2-53b5-8676-10b07587cd4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF14640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 100907,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-10',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Saving data for PF14640: {'auction_closing_time': 1774883334.0, 'created_time': 1774521608.428813, 'last_price_update_time': 1774809484.44899}
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF14640') HTTP/1.1" 204 0
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV15803%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Scrape type for WV15803: 0
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Scrape type for HM75653: 0
2026-03-29 18:38:04 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-29 18:38:04 [auto1.de] INFO: Scrape type for DF94308: 2
2026-03-29 18:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-29 18:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with scrape type 2
2026-03-29 18:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f, identifier: DF94308
2026-03-29 18:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-29 18:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308
2026-03-29 18:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f with identifier: DF94308 to the API
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:15:15Z',
'fuel_type': 'petrol',
'id': 'a6a52d7e-4ce9-5eb9-91f2-6b1ccb8bda7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF94308',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 135320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-05',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-29 18:38:05 [auto1.de] INFO: Saving data for DF94308: {'auction_closing_time': 1774883715.0, 'created_time': 1774521856.722234, 'last_price_update_time': 1774809485.025638}
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF94308') HTTP/1.1" 204 0
2026-03-29 18:38:05 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-29 18:38:06 [scrapy.extensions.logstats] INFO: Crawled 43 pages (at 7 pages/min), scraped 235 items (at 97 items/min)
2026-03-29 18:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:11 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:11 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-29 18:38:11 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-29 18:38:11 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-29 18:38:11 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-29 18:38:11 [auto1.de] INFO: Scrape type for EE00996: 2
2026-03-29 18:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-29 18:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with scrape type 2
2026-03-29 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with scrape type 2
2026-03-29 18:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc, identifier: EE00996
2026-03-29 18:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-29 18:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-29 18:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996 to the API
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:16:30Z',
'fuel_type': 'diesel',
'id': '29a91ab9-2670-5ef0-baa3-cfd18d76a1dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE00996',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XE',
'odometer': 156194,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-21',
'seller_name': None,
'title': 'Jaguar XE 20d Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2015}
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-29 18:38:11 [auto1.de] INFO: Saving data for EE00996: {'auction_closing_time': 1774883790.0, 'created_time': 1773225737.530438, 'last_price_update_time': 1774809491.998565}
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE00996') HTTP/1.1" 204 0
2026-03-29 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:12 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-29 18:38:12 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-29 18:38:12 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-29 18:38:12 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-29 18:38:12 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-29 18:38:12 [auto1.de] INFO: Scrape type for PS83332: 2
2026-03-29 18:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-29 18:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with scrape type 2
2026-03-29 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with scrape type 2
2026-03-29 18:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5, identifier: PS83332
2026-03-29 18:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-29 18:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-29 18:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332 to the API
2026-03-29 18:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:14:32Z',
'fuel_type': 'diesel',
'id': '2ff99d9d-1f8c-5726-90c5-92466b5dfef5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS83332',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery 4',
'odometer': 173269,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-22',
'seller_name': None,
'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 S',
'transmission': 'automatic',
'trim': 'TDV6 S',
'year': 2015}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Saving data for PS83332: {'auction_closing_time': 1774883672.0, 'created_time': 1773134716.789018, 'last_price_update_time': 1774809493.175688}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS83332') HTTP/1.1" 204 0
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Scrape type for FS00408: 2
2026-03-29 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-29 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with scrape type 2
2026-03-29 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with scrape type 2
2026-03-29 18:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea, identifier: FS00408
2026-03-29 18:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-29 18:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-29 18:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408 to the API
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-30T15:20:40Z',
'fuel_type': 'petrol',
'id': 'a0e4d6eb-965b-5ee3-8193-f5b3332c0fea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS00408',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 53248,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Saving data for FS00408: {'auction_closing_time': 1774884040.0, 'created_time': 1774292936.275523, 'last_price_update_time': 1774809493.890894}
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS00408') HTTP/1.1" 204 0
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-29 18:38:13 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-29 18:38:13 [auto1.de] INFO: Scrape type for WE65713: 2
2026-03-29 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-29 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f328ce28-1ef9-5fc2-b973-1c08e853dc14 with scrape type 2
2026-03-29 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f328ce28-1ef9-5fc2-b973-1c08e853dc14 with scrape type 2
2026-03-29 18:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f328ce28-1ef9-5fc2-b973-1c08e853dc14, identifier: WE65713
2026-03-29 18:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-29 18:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-29 18:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713 to the API
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:28:09Z',
'fuel_type': 'petrol',
'id': 'f328ce28-1ef9-5fc2-b973-1c08e853dc14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE65713',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 107995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-22',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 Trendline',
'transmission': 'automatic',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Saving data for WE65713: {'auction_closing_time': 1774884489.0, 'created_time': 1773383274.734436, 'last_price_update_time': 1774809494.4133}
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE65713') HTTP/1.1" 204 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR04951%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for AR04951: 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for CX50338: 0
2026-03-29 18:38:14 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-29 18:38:14 [auto1.de] INFO: Scrape type for HM36828: 2
2026-03-29 18:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-29 18:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdd0b695-89da-5fec-9f8a-0f89bf536b3e with scrape type 2
2026-03-29 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdd0b695-89da-5fec-9f8a-0f89bf536b3e with scrape type 2
2026-03-29 18:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdd0b695-89da-5fec-9f8a-0f89bf536b3e, identifier: HM36828
2026-03-29 18:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-29 18:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828
2026-03-29 18:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdd0b695-89da-5fec-9f8a-0f89bf536b3e with identifier: HM36828 to the API
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:09:21Z',
'fuel_type': 'diesel',
'id': 'bdd0b695-89da-5fec-9f8a-0f89bf536b3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM36828',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 119372,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-16',
'seller_name': None,
'title': 'Mercedes-Benz Vito 119 CDI lang 4Matic',
'transmission': 'automatic',
'trim': 'lang 4Matic',
'year': 2017}
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Saving data for HM36828: {'auction_closing_time': 1774883361.0, 'created_time': 1773861769.99404, 'last_price_update_time': 1774809495.045332}
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM36828') HTTP/1.1" 204 0
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for RD48040: 2
2026-03-29 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-29 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32564bb-c139-52af-bbbe-d4f17d68ca7b with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32564bb-c139-52af-bbbe-d4f17d68ca7b with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c32564bb-c139-52af-bbbe-d4f17d68ca7b, identifier: RD48040
2026-03-29 18:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-29 18:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-29 18:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040 to the API
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:21:32Z',
'fuel_type': 'petrol',
'id': 'c32564bb-c139-52af-bbbe-d4f17d68ca7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD48040',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 305523,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1992-10-31',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse 200 E',
'transmission': 'manual',
'trim': '',
'year': 1992}
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Saving data for RD48040: {'auction_closing_time': 1774884092.0, 'created_time': 1774294103.875521, 'last_price_update_time': 1774809495.473224}
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD48040') HTTP/1.1" 204 0
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for CD05825: 0
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75673%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for LN75673: 0
2026-03-29 18:38:15 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-29 18:38:15 [auto1.de] INFO: Scrape type for UM10671: 2
2026-03-29 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-29 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with scrape type 2
2026-03-29 18:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af290f05-34d9-53ae-9ec7-07ccb5a76ca6, identifier: UM10671
2026-03-29 18:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-29 18:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-29 18:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671 to the API
2026-03-29 18:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:19:55Z',
'fuel_type': 'petrol',
'id': 'af290f05-34d9-53ae-9ec7-07ccb5a76ca6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM10671',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Orlando',
'odometer': 219462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-30',
'seller_name': None,
'title': 'Chevrolet Orlando 1.4 TURBO LTZ',
'transmission': 'manual',
'trim': 'LTZ',
'year': 2014}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Saving data for UM10671: {'auction_closing_time': 1774883995.0, 'created_time': 1773860982.54036, 'last_price_update_time': 1774809496.231226}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM10671') HTTP/1.1" 204 0
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Scrape type for JV89856: 2
2026-03-29 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-29 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with scrape type 2
2026-03-29 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with scrape type 2
2026-03-29 18:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94, identifier: JV89856
2026-03-29 18:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-29 18:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-29 18:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856 to the API
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:00:20Z',
'fuel_type': 'petrol',
'id': '90fe141c-7c36-5dbf-9580-66dd0d7bfd94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV89856',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 24250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-17',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2020}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Saving data for JV89856: {'auction_closing_time': 1774882820.0, 'created_time': 1773687305.07223, 'last_price_update_time': 1774809496.800308}
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV89856') HTTP/1.1" 204 0
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-29 18:38:16 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-29 18:38:16 [auto1.de] INFO: Scrape type for GX08405: 2
2026-03-29 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-29 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3456634d-de35-50d2-bc34-707358a3ac0e with scrape type 2
2026-03-29 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3456634d-de35-50d2-bc34-707358a3ac0e with scrape type 2
2026-03-29 18:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3456634d-de35-50d2-bc34-707358a3ac0e, identifier: GX08405
2026-03-29 18:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-29 18:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-29 18:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405 to the API
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:03:55Z',
'fuel_type': 'diesel',
'id': '3456634d-de35-50d2-bc34-707358a3ac0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX08405',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 167316,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-13',
'seller_name': None,
'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Saving data for GX08405: {'auction_closing_time': 1774883035.0, 'created_time': 1773383178.714776, 'last_price_update_time': 1774809497.243054}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX08405') HTTP/1.1" 204 0
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Scrape type for BL21282: 2
2026-03-29 18:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-29 18:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b10da27-c2e5-5c37-a066-a925fbd813c8 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b10da27-c2e5-5c37-a066-a925fbd813c8 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b10da27-c2e5-5c37-a066-a925fbd813c8, identifier: BL21282
2026-03-29 18:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-29 18:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282
2026-03-29 18:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b10da27-c2e5-5c37-a066-a925fbd813c8 with identifier: BL21282 to the API
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:06:26Z',
'fuel_type': 'diesel',
'id': '9b10da27-c2e5-5c37-a066-a925fbd813c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL21282',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 123482,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-21',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2015}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Saving data for BL21282: {'auction_closing_time': 1774883186.0, 'created_time': 1773341511.72998, 'last_price_update_time': 1774809497.729961}
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL21282') HTTP/1.1" 204 0
2026-03-29 18:38:17 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-29 18:38:17 [auto1.de] INFO: Scrape type for KU58060: 2
2026-03-29 18:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-29 18:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbfca0e1-a683-53be-bb8a-c3faa05ff005 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbfca0e1-a683-53be-bb8a-c3faa05ff005 with scrape type 2
2026-03-29 18:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbfca0e1-a683-53be-bb8a-c3faa05ff005, identifier: KU58060
2026-03-29 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-29 18:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-29 18:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060 to the API
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:48:34Z',
'fuel_type': 'petrol',
'id': 'fbfca0e1-a683-53be-bb8a-c3faa05ff005',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU58060',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 38446,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 TSI Edition 20 4Motion',
'transmission': 'automatic',
'trim': 'Edition 20 4Motion',
'year': 2022}
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Saving data for KU58060: {'auction_closing_time': 1774885714.0, 'created_time': 1773773986.817217, 'last_price_update_time': 1774809498.253165}
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU58060') HTTP/1.1" 204 0
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-29 18:38:18 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-29 18:38:18 [auto1.de] INFO: Scrape type for HD41373: 2
2026-03-29 18:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-29 18:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f85bf86-1906-540b-ae61-c658748f15ce with scrape type 2
2026-03-29 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f85bf86-1906-540b-ae61-c658748f15ce with scrape type 2
2026-03-29 18:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f85bf86-1906-540b-ae61-c658748f15ce, identifier: HD41373
2026-03-29 18:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-29 18:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-29 18:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373 to the API
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:28:47Z',
'fuel_type': 'diesel',
'id': '9f85bf86-1906-540b-ae61-c658748f15ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD41373',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 187442,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-19',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-29 18:38:19 [auto1.de] INFO: Saving data for HD41373: {'auction_closing_time': 1774884527.0, 'created_time': 1773776049.998221, 'last_price_update_time': 1774809499.018826}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD41373') HTTP/1.1" 204 0
2026-03-29 18:38:19 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-29 18:38:19 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-29 18:38:19 [auto1.de] INFO: Scrape type for SH55749: 2
2026-03-29 18:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749
2026-03-29 18:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with scrape type 2
2026-03-29 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with scrape type 2
2026-03-29 18:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262, identifier: SH55749
2026-03-29 18:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749
2026-03-29 18:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749
2026-03-29 18:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ab9f9e7-a1eb-5729-9ab1-396819cdb262 with identifier: SH55749 to the API
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:51:34Z',
'fuel_type': 'petrol',
'id': '4ab9f9e7-a1eb-5729-9ab1-396819cdb262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH55749',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 22125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-02',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Experience',
'transmission': 'manual',
'trim': 'Experience',
'year': 2016}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-29 18:38:19 [auto1.de] INFO: Saving data for SH55749: {'auction_closing_time': 1774885894.0, 'created_time': 1773947026.48262, 'last_price_update_time': 1774809499.739912}
2026-03-29 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH55749') HTTP/1.1" 204 0
2026-03-29 18:38:20 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:20 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-29 18:38:20 [auto1.de] INFO: Scrape type for MY79904: 2
2026-03-29 18:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-29 18:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with scrape type 2
2026-03-29 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with scrape type 2
2026-03-29 18:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be, identifier: MY79904
2026-03-29 18:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-29 18:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-29 18:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904 to the API
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 392,
'expiration_date': '2026-03-30T15:17:01Z',
'fuel_type': 'hybrid',
'id': '79bbc902-3b1f-580e-a0e7-9c7c5f2182be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY79904',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 202654,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seller_name': None,
'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid R-Design AWD',
'transmission': 'automatic',
'trim': 'R-Design AWD',
'year': 2019}
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-29 18:38:21 [auto1.de] INFO: Saving data for MY79904: {'auction_closing_time': 1774883821.0, 'created_time': 1773861179.070441, 'last_price_update_time': 1774809501.440025}
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY79904') HTTP/1.1" 204 0
2026-03-29 18:38:21 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-29 18:38:21 [auto1.de] INFO: Scrape type for VU47138: 2
2026-03-29 18:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-29 18:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b95a58-3d44-502c-b3c8-f522845bd629 with scrape type 2
2026-03-29 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b95a58-3d44-502c-b3c8-f522845bd629 with scrape type 2
2026-03-29 18:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27b95a58-3d44-502c-b3c8-f522845bd629, identifier: VU47138
2026-03-29 18:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-29 18:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-29 18:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138 to the API
2026-03-29 18:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:20:24Z',
'fuel_type': 'diesel',
'id': '27b95a58-3d44-502c-b3c8-f522845bd629',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU47138',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 304026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-07',
'seller_name': None,
'title': 'BMW X5 3.0d',
'transmission': 'automatic',
'trim': '',
'year': 2003}
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Saving data for VU47138: {'auction_closing_time': 1774884024.0, 'created_time': 1774262994.748112, 'last_price_update_time': 1774809502.121872}
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU47138') HTTP/1.1" 204 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for GT07597: 2
2026-03-29 18:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-29 18:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94618181-a007-5681-a993-99cd06fd6684 with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94618181-a007-5681-a993-99cd06fd6684 with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94618181-a007-5681-a993-99cd06fd6684, identifier: GT07597
2026-03-29 18:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-29 18:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-29 18:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597 to the API
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:11:37Z',
'fuel_type': 'diesel',
'id': '94618181-a007-5681-a993-99cd06fd6684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT07597',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 272188,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-28',
'seller_name': None,
'title': 'BMW 5er 525d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Saving data for GT07597: {'auction_closing_time': 1774883497.0, 'created_time': 1773306241.494342, 'last_price_update_time': 1774809502.599395}
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT07597') HTTP/1.1" 204 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for AZ40865: 0
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-29 18:38:22 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-29 18:38:22 [auto1.de] INFO: Scrape type for SG62181: 2
2026-03-29 18:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-29 18:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1db094-54cf-55ed-8018-cdbe6b68dc7f with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef1db094-54cf-55ed-8018-cdbe6b68dc7f with scrape type 2
2026-03-29 18:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef1db094-54cf-55ed-8018-cdbe6b68dc7f, identifier: SG62181
2026-03-29 18:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-29 18:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-29 18:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181 to the API
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:15:42Z',
'fuel_type': 'petrol',
'id': 'ef1db094-54cf-55ed-8018-cdbe6b68dc7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG62181',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 157725,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-16',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI Business Edition BlueMotion',
'transmission': 'automatic',
'trim': 'Business Edition BlueMotion',
'year': 2014}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Saving data for SG62181: {'auction_closing_time': 1774883742.0, 'created_time': 1774293913.418717, 'last_price_update_time': 1774809503.085896}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG62181') HTTP/1.1" 204 0
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Scrape type for AB35938: 2
2026-03-29 18:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-29 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b, identifier: AB35938
2026-03-29 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-29 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-29 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938 to the API
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:42:05Z',
'fuel_type': 'petrol',
'id': '9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB35938',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 127928,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-19',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Style Viva',
'transmission': 'manual',
'trim': 'Style Viva',
'year': 2012}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Saving data for AB35938: {'auction_closing_time': 1774885325.0, 'created_time': 1774607810.917283, 'last_price_update_time': 1774809503.561931}
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB35938') HTTP/1.1" 204 0
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD57805%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Scrape type for TD57805: 0
2026-03-29 18:38:23 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-29 18:38:23 [auto1.de] INFO: Scrape type for BC03765: 2
2026-03-29 18:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-29 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96e779b-2971-5caf-bea1-537a3b19961b with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96e779b-2971-5caf-bea1-537a3b19961b with scrape type 2
2026-03-29 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96e779b-2971-5caf-bea1-537a3b19961b, identifier: BC03765
2026-03-29 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-29 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-29 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765 to the API
2026-03-29 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:23:01Z',
'fuel_type': 'diesel',
'id': 'c96e779b-2971-5caf-bea1-537a3b19961b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC03765',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 229716,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-02',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2015}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Saving data for BC03765: {'auction_closing_time': 1774884181.0, 'created_time': 1773426929.674773, 'last_price_update_time': 1774809504.177425}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC03765') HTTP/1.1" 204 0
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Scrape type for SP41921: 2
2026-03-29 18:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-29 18:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c5914a-085d-5791-ad81-66cf3b603e11 with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55c5914a-085d-5791-ad81-66cf3b603e11 with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55c5914a-085d-5791-ad81-66cf3b603e11, identifier: SP41921
2026-03-29 18:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-29 18:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-29 18:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921 to the API
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:26Z',
'fuel_type': 'diesel',
'id': '55c5914a-085d-5791-ad81-66cf3b603e11',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP41921',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 178506,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-05',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Saving data for SP41921: {'auction_closing_time': 1774884446.0, 'created_time': 1774608039.338563, 'last_price_update_time': 1774809504.655649}
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP41921') HTTP/1.1" 204 0
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Scrape type for XB58662: 0
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-29 18:38:24 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-29 18:38:24 [auto1.de] INFO: Scrape type for YR74432: 2
2026-03-29 18:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-29 18:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with scrape type 2
2026-03-29 18:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cc4cd8e-8bcf-5a22-bd34-30f574283794, identifier: YR74432
2026-03-29 18:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-29 18:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-29 18:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432 to the API
2026-03-29 18:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:34:08Z',
'fuel_type': 'petrol',
'id': '0cc4cd8e-8bcf-5a22-bd34-30f574283794',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR74432',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 150471,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-19',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2008}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Saving data for YR74432: {'auction_closing_time': 1774884848.0, 'created_time': 1774608098.64953, 'last_price_update_time': 1774809505.125798}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR74432') HTTP/1.1" 204 0
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Scrape type for SG66874: 2
2026-03-29 18:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-29 18:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1de4729-38d0-5f1e-a0ac-82437315f359 with scrape type 2
2026-03-29 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1de4729-38d0-5f1e-a0ac-82437315f359 with scrape type 2
2026-03-29 18:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1de4729-38d0-5f1e-a0ac-82437315f359, identifier: SG66874
2026-03-29 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-29 18:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-29 18:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874 to the API
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:30:25Z',
'fuel_type': 'petrol',
'id': 'd1de4729-38d0-5f1e-a0ac-82437315f359',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG66874',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 109019,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-09',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Saving data for SG66874: {'auction_closing_time': 1774884625.0, 'created_time': 1773305322.502021, 'last_price_update_time': 1774809505.685259}
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG66874') HTTP/1.1" 204 0
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-29 18:38:25 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-29 18:38:25 [auto1.de] INFO: Scrape type for BT34315: 2
2026-03-29 18:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-29 18:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with scrape type 2
2026-03-29 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with scrape type 2
2026-03-29 18:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 462fad6c-41c2-5a87-85d1-9ed0f67efd97, identifier: BT34315
2026-03-29 18:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-29 18:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-29 18:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315 to the API
2026-03-29 18:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:31:14Z',
'fuel_type': 'petrol',
'id': '462fad6c-41c2-5a87-85d1-9ed0f67efd97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT34315',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 108042,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-19',
'seller_name': None,
'title': 'Fiat Punto Evo 1.2 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Saving data for BT34315: {'auction_closing_time': 1774884674.0, 'created_time': 1773381990.593559, 'last_price_update_time': 1774809506.166522}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT34315') HTTP/1.1" 204 0
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Scrape type for SL44411: 2
2026-03-29 18:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-29 18:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d1df71-673f-532d-90c4-f7829d23ae38 with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d1df71-673f-532d-90c4-f7829d23ae38 with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34d1df71-673f-532d-90c4-f7829d23ae38, identifier: SL44411
2026-03-29 18:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-29 18:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-29 18:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411 to the API
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:15:01Z',
'fuel_type': 'petrol',
'id': '34d1df71-673f-532d-90c4-f7829d23ae38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL44411',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 234069,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-11',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Saving data for SL44411: {'auction_closing_time': 1774883701.0, 'created_time': 1773381763.482062, 'last_price_update_time': 1774809506.628095}
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL44411') HTTP/1.1" 204 0
2026-03-29 18:38:26 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-29 18:38:26 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-29 18:38:26 [auto1.de] INFO: Scrape type for BK53036: 2
2026-03-29 18:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-29 18:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12eeedbd-107e-5689-b2b4-ee044ea48bfa with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12eeedbd-107e-5689-b2b4-ee044ea48bfa with scrape type 2
2026-03-29 18:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12eeedbd-107e-5689-b2b4-ee044ea48bfa, identifier: BK53036
2026-03-29 18:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-29 18:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-29 18:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036 to the API
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:48:19Z',
'fuel_type': 'diesel',
'id': '12eeedbd-107e-5689-b2b4-ee044ea48bfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK53036',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 158403,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-16',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2012}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Saving data for BK53036: {'auction_closing_time': 1774885699.0, 'created_time': 1774294786.521126, 'last_price_update_time': 1774809507.056111}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK53036') HTTP/1.1" 204 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ25719%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for VZ25719: 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA82816%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for KA82816: 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for UT22988: 2
2026-03-29 18:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-29 18:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966ecc0f-723b-5611-84f1-abfa73e497d3 with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 966ecc0f-723b-5611-84f1-abfa73e497d3 with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 966ecc0f-723b-5611-84f1-abfa73e497d3, identifier: UT22988
2026-03-29 18:38:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for CF43434: 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-29 18:38:27 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Scrape type for KH74255: 2
2026-03-29 18:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-29 18:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11029a6c-6e5f-562f-aff9-b34fe1b6565c with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11029a6c-6e5f-562f-aff9-b34fe1b6565c with scrape type 2
2026-03-29 18:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11029a6c-6e5f-562f-aff9-b34fe1b6565c, identifier: KH74255
2026-03-29 18:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-29 18:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-29 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988 to the API
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:06:14Z',
'fuel_type': 'petrol',
'id': '966ecc0f-723b-5611-84f1-abfa73e497d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT22988',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 90814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-23',
'seller_name': None,
'title': 'Suzuki Jimny 1.3 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2015}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-29 18:38:27 [auto1.de] INFO: Saving data for UT22988: {'auction_closing_time': 1774883174.0, 'created_time': 1773380973.573565, 'last_price_update_time': 1774809507.798483}
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT22988') HTTP/1.1" 204 0
2026-03-29 18:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-29 18:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-29 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255 to the API
2026-03-29 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:29:43Z',
'fuel_type': 'petrol',
'id': '11029a6c-6e5f-562f-aff9-b34fe1b6565c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH74255',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 15350,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-23',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2024}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Saving data for KH74255: {'auction_closing_time': 1774884583.0, 'created_time': 1773305913.564122, 'last_price_update_time': 1774809508.211876}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH74255') HTTP/1.1" 204 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ97003%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for BJ97003: 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for LP76245: 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for WP14042: 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH70992%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for MH70992: 0
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for EC33750: 2
2026-03-29 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-29 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f15e52c7-f347-5b54-90a2-8994327b9a7d with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f15e52c7-f347-5b54-90a2-8994327b9a7d with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f15e52c7-f347-5b54-90a2-8994327b9a7d, identifier: EC33750
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-29 18:38:28 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Scrape type for NU04580: 2
2026-03-29 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-29 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 515d0a17-cd83-5781-b362-9ea184b1f5df with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 515d0a17-cd83-5781-b362-9ea184b1f5df with scrape type 2
2026-03-29 18:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 515d0a17-cd83-5781-b362-9ea184b1f5df, identifier: NU04580
2026-03-29 18:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-29 18:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-29 18:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750 to the API
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:03Z',
'fuel_type': 'diesel',
'id': 'f15e52c7-f347-5b54-90a2-8994327b9a7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC33750',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 149514,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-14',
'seller_name': None,
'title': 'Mitsubishi ASX 2.2 DI-D Edition 100+ 4WD',
'transmission': 'automatic',
'trim': 'Edition 100+ 4WD',
'year': 2017}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-29 18:38:28 [auto1.de] INFO: Saving data for EC33750: {'auction_closing_time': 1774885563.0, 'created_time': 1774350446.49065, 'last_price_update_time': 1774809508.8466}
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC33750') HTTP/1.1" 204 0
2026-03-29 18:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-29 18:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580
2026-03-29 18:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 515d0a17-cd83-5781-b362-9ea184b1f5df with identifier: NU04580 to the API
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:45:28Z',
'fuel_type': 'diesel',
'id': '515d0a17-cd83-5781-b362-9ea184b1f5df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU04580',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 243220,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-02',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
'transmission': 'manual',
'trim': 'T BlueTEC',
'year': 2016}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Saving data for NU04580: {'auction_closing_time': 1774885528.0, 'created_time': 1773341063.311142, 'last_price_update_time': 1774809509.252718}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU04580') HTTP/1.1" 204 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC28332%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for JC28332: 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN44091%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for HN44091: 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for AB27737: 0
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for AB91647: 2
2026-03-29 18:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-29 18:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82514085-ea9c-5a21-a143-2bb590533a6a with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82514085-ea9c-5a21-a143-2bb590533a6a with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82514085-ea9c-5a21-a143-2bb590533a6a, identifier: AB91647
2026-03-29 18:38:29 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Scrape type for TL23560: 2
2026-03-29 18:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-29 18:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b71fb49-9367-5d14-a749-7b3a6867db91 with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b71fb49-9367-5d14-a749-7b3a6867db91 with scrape type 2
2026-03-29 18:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b71fb49-9367-5d14-a749-7b3a6867db91, identifier: TL23560
2026-03-29 18:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-29 18:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-29 18:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647 to the API
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:48:24Z',
'fuel_type': 'petrol',
'id': '82514085-ea9c-5a21-a143-2bb590533a6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB91647',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 49148,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-23',
'seller_name': None,
'title': 'Seat Leon 1.2 TSI Style Copa Ecomotive',
'transmission': 'manual',
'trim': 'Style Copa Ecomotive',
'year': 2012}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-29 18:38:29 [auto1.de] INFO: Saving data for AB91647: {'auction_closing_time': 1774885704.0, 'created_time': 1773946002.100934, 'last_price_update_time': 1774809509.896465}
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB91647') HTTP/1.1" 204 0
2026-03-29 18:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-29 18:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-29 18:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560 to the API
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:33:33Z',
'fuel_type': 'petrol',
'id': '1b71fb49-9367-5d14-a749-7b3a6867db91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL23560',
'listing': 'auction',
'make': 'Fiat',
'model': 'Sedici',
'odometer': 103933,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-29',
'seller_name': None,
'title': 'Fiat Sedici 1.6 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2010}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Saving data for TL23560: {'auction_closing_time': 1774884813.0, 'created_time': 1774294390.48762, 'last_price_update_time': 1774809510.241256}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL23560') HTTP/1.1" 204 0
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Scrape type for HM57840: 2
2026-03-29 18:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-29 18:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1840c47c-e51b-5fee-bfff-05055c749594 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1840c47c-e51b-5fee-bfff-05055c749594 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1840c47c-e51b-5fee-bfff-05055c749594, identifier: HM57840
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Scrape type for BE47693: 0
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-29 18:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-29 18:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-29 18:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840 to the API
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:33:13Z',
'fuel_type': 'petrol',
'id': '1840c47c-e51b-5fee-bfff-05055c749594',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM57840',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Colt',
'odometer': 103504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-11',
'seller_name': None,
'title': 'Mitsubishi Colt 1.1 ClearTec Inform',
'transmission': 'manual',
'trim': 'ClearTec Inform',
'year': 2009}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Saving data for HM57840: {'auction_closing_time': 1774884793.0, 'created_time': 1774608090.429291, 'last_price_update_time': 1774809510.718591}
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM57840') HTTP/1.1" 204 0
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-29 18:38:30 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-29 18:38:30 [auto1.de] INFO: Scrape type for AM15816: 2
2026-03-29 18:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-29 18:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c7c327-8ad4-501a-87c8-8ea9167146f9 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c7c327-8ad4-501a-87c8-8ea9167146f9 with scrape type 2
2026-03-29 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3c7c327-8ad4-501a-87c8-8ea9167146f9, identifier: AM15816
2026-03-29 18:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-29 18:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-29 18:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816 to the API
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:32:22Z',
'fuel_type': 'petrol',
'id': 'a3c7c327-8ad4-501a-87c8-8ea9167146f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM15816',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 182668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-19',
'seller_name': None,
'title': 'Suzuki SX4 1.5 Streetline Classic',
'transmission': 'manual',
'trim': 'Streetline Classic',
'year': 2009}
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-29 18:38:31 [auto1.de] INFO: Saving data for AM15816: {'auction_closing_time': 1774884742.0, 'created_time': 1774293061.861027, 'last_price_update_time': 1774809511.727346}
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM15816') HTTP/1.1" 204 0
2026-03-29 18:38:31 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-29 18:38:31 [auto1.de] INFO: Scrape type for AX08023: 2
2026-03-29 18:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-29 18:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a12a14e-b05d-5016-a566-77e4c8abff50 with scrape type 2
2026-03-29 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a12a14e-b05d-5016-a566-77e4c8abff50 with scrape type 2
2026-03-29 18:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a12a14e-b05d-5016-a566-77e4c8abff50, identifier: AX08023
2026-03-29 18:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-29 18:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023
2026-03-29 18:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a12a14e-b05d-5016-a566-77e4c8abff50 with identifier: AX08023 to the API
2026-03-29 18:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:17:42Z',
'fuel_type': 'diesel',
'id': '4a12a14e-b05d-5016-a566-77e4c8abff50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX08023',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque Cabriolet',
'odometer': 99243,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seller_name': None,
'title': 'Land Rover Evoque Cabriolet 2.0 Td4 HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2017}
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Saving data for AX08023: {'auction_closing_time': 1774883862.0, 'created_time': 1774522440.648222, 'last_price_update_time': 1774809512.157499}
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX08023') HTTP/1.1" 204 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for YE15667: 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF52928%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for MF52928: 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH75951%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for VH75951: 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for NV16003: 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for XZ81913: 0
2026-03-29 18:38:32 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-29 18:38:32 [auto1.de] INFO: Scrape type for EZ76409: 0
2026-03-29 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:33 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for ZP35673: 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE98094%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for DE98094: 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for EJ47676: 2
2026-03-29 18:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-29 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc, identifier: EJ47676
2026-03-29 18:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-29 18:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-29 18:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676 to the API
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:35:32Z',
'fuel_type': 'diesel',
'id': '19d2bdcf-827a-5a9d-82e6-277e49db4bcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ47676',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 159800,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-01',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2015}
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Saving data for EJ47676: {'auction_closing_time': 1774884932.0, 'created_time': 1773227164.060533, 'last_price_update_time': 1774809513.608764}
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ47676') HTTP/1.1" 204 0
2026-03-29 18:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC90935%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for SC90935: 0
2026-03-29 18:38:33 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-29 18:38:33 [auto1.de] INFO: Scrape type for PR56411: 2
2026-03-29 18:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-29 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54827405-4c25-51bb-abc2-5e8043bc3c6d with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54827405-4c25-51bb-abc2-5e8043bc3c6d with scrape type 2
2026-03-29 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54827405-4c25-51bb-abc2-5e8043bc3c6d, identifier: PR56411
2026-03-29 18:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-29 18:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-29 18:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411 to the API
2026-03-29 18:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:45:10Z',
'fuel_type': 'petrol',
'id': '54827405-4c25-51bb-abc2-5e8043bc3c6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR56411',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 142346,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-13',
'seller_name': None,
'title': 'Volvo V90 2.0 T4 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2018}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Saving data for PR56411: {'auction_closing_time': 1774885510.0, 'created_time': 1773858952.110516, 'last_price_update_time': 1774809514.176047}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR56411') HTTP/1.1" 204 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for ZE90376: 2
2026-03-29 18:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-29 18:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aac36263-1b24-5c0a-8dc9-5ff1b48eef21, identifier: ZE90376
2026-03-29 18:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-29 18:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-29 18:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376 to the API
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:25:23Z',
'fuel_type': 'petrol',
'id': 'aac36263-1b24-5c0a-8dc9-5ff1b48eef21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE90376',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 13000,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-10-13',
'seller_name': None,
'title': 'Skoda Karoq 2.0 TSI Sportline 4x4',
'transmission': 'automatic',
'trim': 'Sportline 4x4',
'year': 2024}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Saving data for ZE90376: {'auction_closing_time': 1774884323.0, 'created_time': 1772728480.041797, 'last_price_update_time': 1774809514.663055}
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE90376') HTTP/1.1" 204 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09609%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for NK09609: 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for UL75790: 0
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-29 18:38:34 [auto1.de] INFO: Found listing with ID: US49854
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US49854%27 HTTP/1.1" 200 None
2026-03-29 18:38:34 [auto1.de] INFO: Scrape type for US49854: 2
2026-03-29 18:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854
2026-03-29 18:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40912591-fd9c-5901-963e-8427a3878932 with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40912591-fd9c-5901-963e-8427a3878932 with scrape type 2
2026-03-29 18:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40912591-fd9c-5901-963e-8427a3878932, identifier: US49854
2026-03-29 18:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854
2026-03-29 18:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854
2026-03-29 18:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40912591-fd9c-5901-963e-8427a3878932 with identifier: US49854 to the API
2026-03-29 18:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:03:51Z',
'fuel_type': 'diesel',
'id': '40912591-fd9c-5901-963e-8427a3878932',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US49854',
'listing': 'auction',
'make': 'Ford',
'model': 'Edge',
'odometer': 73325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-28',
'seller_name': None,
'title': 'Ford Edge 2.0 TDCi Bi-Turbo Titanium 4x4',
'transmission': 'automatic',
'trim': 'Titanium 4x4',
'year': 2017}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US49854%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Saving data for US49854: {'auction_closing_time': 1774883031.0, 'created_time': 1773429518.74195, 'last_price_update_time': 1774809515.146789}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US49854') HTTP/1.1" 204 0
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Scrape type for BE14691: 0
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Scrape type for FC97863: 2
2026-03-29 18:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-29 18:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61cfaff5-319c-5618-9753-1facae6b8c7e with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61cfaff5-319c-5618-9753-1facae6b8c7e with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61cfaff5-319c-5618-9753-1facae6b8c7e, identifier: FC97863
2026-03-29 18:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-29 18:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863
2026-03-29 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61cfaff5-319c-5618-9753-1facae6b8c7e with identifier: FC97863 to the API
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:56:24Z',
'fuel_type': 'petrol',
'id': '61cfaff5-319c-5618-9753-1facae6b8c7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC97863',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 190144,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-30',
'seller_name': None,
'title': 'BMW 3er 330i GT xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2017}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Saving data for FC97863: {'auction_closing_time': 1774886184.0, 'created_time': 1774521949.92873, 'last_price_update_time': 1774809515.682092}
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC97863') HTTP/1.1" 204 0
2026-03-29 18:38:35 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-29 18:38:35 [auto1.de] INFO: Scrape type for MR34714: 2
2026-03-29 18:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-29 18:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea3d14a-19a8-56c3-b23d-aec013038f1c with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ea3d14a-19a8-56c3-b23d-aec013038f1c with scrape type 2
2026-03-29 18:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ea3d14a-19a8-56c3-b23d-aec013038f1c, identifier: MR34714
2026-03-29 18:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-29 18:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-29 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714 to the API
2026-03-29 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:38:50Z',
'fuel_type': 'petrol',
'id': '6ea3d14a-19a8-56c3-b23d-aec013038f1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR34714',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 97256,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-13',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2005}
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Saving data for MR34714: {'auction_closing_time': 1774885130.0, 'created_time': 1774033519.700841, 'last_price_update_time': 1774809516.133193}
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR34714') HTTP/1.1" 204 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE15038%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for CE15038: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG49246%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for RG49246: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-29 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:36 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR49989%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for LR49989: 0
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-29 18:38:36 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-29 18:38:36 [auto1.de] INFO: Scrape type for XT91998: 2
2026-03-29 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-29 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with scrape type 2
2026-03-29 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with scrape type 2
2026-03-29 18:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106, identifier: XT91998
2026-03-29 18:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-29 18:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-29 18:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998 to the API
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:54Z',
'fuel_type': 'petrol',
'id': '7b6ff8f5-36d4-5d7c-b547-c6d0355e5106',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT91998',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 43450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-26',
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2018}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Saving data for XT91998: {'auction_closing_time': 1774884714.0, 'created_time': 1773381016.251702, 'last_price_update_time': 1774809517.03571}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT91998') HTTP/1.1" 204 0
2026-03-29 18:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET94101%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Scrape type for ET94101: 0
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Scrape type for BP39068: 2
2026-03-29 18:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-29 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f56b8c1-1690-5501-80f2-acef6636981e with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f56b8c1-1690-5501-80f2-acef6636981e with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f56b8c1-1690-5501-80f2-acef6636981e, identifier: BP39068
2026-03-29 18:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-29 18:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-29 18:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068 to the API
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:45:04Z',
'fuel_type': 'diesel',
'id': '2f56b8c1-1690-5501-80f2-acef6636981e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP39068',
'listing': 'auction',
'make': 'Nissan',
'model': 'NP300 Pick-up',
'odometer': 248615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-13',
'seller_name': None,
'title': 'Nissan NP300 Pick-up 2.3 dCi N-Connecta Double Cab 4x4',
'transmission': 'manual',
'trim': 'N-Connecta Double Cab 4x4',
'year': 2017}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Saving data for BP39068: {'auction_closing_time': 1774885504.0, 'created_time': 1774608597.100698, 'last_price_update_time': 1774809517.620001}
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP39068') HTTP/1.1" 204 0
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-29 18:38:37 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-29 18:38:37 [auto1.de] INFO: Scrape type for DL95738: 2
2026-03-29 18:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-29 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187cd142-355a-50cf-9ea4-36b7f4144508 with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187cd142-355a-50cf-9ea4-36b7f4144508 with scrape type 2
2026-03-29 18:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 187cd142-355a-50cf-9ea4-36b7f4144508, identifier: DL95738
2026-03-29 18:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-29 18:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-29 18:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738 to the API
2026-03-29 18:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:35:23Z',
'fuel_type': 'petrol',
'id': '187cd142-355a-50cf-9ea4-36b7f4144508',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL95738',
'listing': 'auction',
'make': 'Volvo',
'model': 'S40',
'odometer': 124598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-30',
'seller_name': None,
'title': 'Volvo S40 1.8',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-29 18:38:38 [auto1.de] INFO: Saving data for DL95738: {'auction_closing_time': 1774884923.0, 'created_time': 1773688963.872421, 'last_price_update_time': 1774809518.881743}
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL95738') HTTP/1.1" 204 0
2026-03-29 18:38:38 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-29 18:38:38 [auto1.de] INFO: Scrape type for SZ97715: 2
2026-03-29 18:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715
2026-03-29 18:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187f86de-8f64-53d7-bed2-200c880b6ccd with scrape type 2
2026-03-29 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187f86de-8f64-53d7-bed2-200c880b6ccd with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 187f86de-8f64-53d7-bed2-200c880b6ccd, identifier: SZ97715
2026-03-29 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715
2026-03-29 18:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715
2026-03-29 18:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 187f86de-8f64-53d7-bed2-200c880b6ccd with identifier: SZ97715 to the API
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:39:13Z',
'fuel_type': 'petrol',
'id': '187f86de-8f64-53d7-bed2-200c880b6ccd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ97715',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 175981,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-28',
'seller_name': None,
'title': 'Toyota Corolla 1.6 Compact Edition',
'transmission': 'manual',
'trim': 'Compact Edition',
'year': 2007}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Saving data for SZ97715: {'auction_closing_time': 1774885153.0, 'created_time': 1774636600.917641, 'last_price_update_time': 1774809519.267343}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ97715') HTTP/1.1" 204 0
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Scrape type for YV03143: 2
2026-03-29 18:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-29 18:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95497ab5-d796-5a75-b63c-adc9989dba64 with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95497ab5-d796-5a75-b63c-adc9989dba64 with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95497ab5-d796-5a75-b63c-adc9989dba64, identifier: YV03143
2026-03-29 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-29 18:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-29 18:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143 to the API
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 330,
'expiration_date': '2026-03-30T15:59:45Z',
'fuel_type': 'diesel',
'id': '95497ab5-d796-5a75-b63c-adc9989dba64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV03143',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 81188,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-23',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2020}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Saving data for YV03143: {'auction_closing_time': 1774886385.0, 'created_time': 1773302118.407971, 'last_price_update_time': 1774809519.796029}
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV03143') HTTP/1.1" 204 0
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ34801%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Scrape type for BJ34801: 0
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-29 18:38:39 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-29 18:38:39 [auto1.de] INFO: Scrape type for VJ57746: 2
2026-03-29 18:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-29 18:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156d4b01-0253-5152-be00-3ba89d411dd7 with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 156d4b01-0253-5152-be00-3ba89d411dd7 with scrape type 2
2026-03-29 18:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 156d4b01-0253-5152-be00-3ba89d411dd7, identifier: VJ57746
2026-03-29 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-29 18:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746
2026-03-29 18:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 156d4b01-0253-5152-be00-3ba89d411dd7 with identifier: VJ57746 to the API
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:56Z',
'fuel_type': 'diesel',
'id': '156d4b01-0253-5152-be00-3ba89d411dd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ57746',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 111995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-06',
'seller_name': None,
'title': 'BMW 1er 118d M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2016}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Saving data for VJ57746: {'auction_closing_time': 1774884056.0, 'created_time': 1774522496.847732, 'last_price_update_time': 1774809520.249747}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ57746') HTTP/1.1" 204 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for BD51611: 2
2026-03-29 18:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-29 18:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6394e207-b268-51c9-b24f-7418e5b80f7c with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6394e207-b268-51c9-b24f-7418e5b80f7c with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6394e207-b268-51c9-b24f-7418e5b80f7c, identifier: BD51611
2026-03-29 18:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-29 18:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-29 18:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611 to the API
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:16:59Z',
'fuel_type': 'petrol',
'id': '6394e207-b268-51c9-b24f-7418e5b80f7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD51611',
'listing': 'auction',
'make': 'Ford',
'model': 'Fusion',
'odometer': 147851,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-30',
'seller_name': None,
'title': 'Ford Fusion 1.25 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2005}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Saving data for BD51611: {'auction_closing_time': 1774883819.0, 'created_time': 1774608015.602678, 'last_price_update_time': 1774809520.775942}
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD51611') HTTP/1.1" 204 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for MK66887: 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for VH61695: 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37163%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for BG37163: 0
2026-03-29 18:38:40 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-29 18:38:40 [auto1.de] INFO: Scrape type for AZ42176: 2
2026-03-29 18:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-29 18:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with scrape type 2
2026-03-29 18:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c, identifier: AZ42176
2026-03-29 18:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-29 18:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-29 18:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176 to the API
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:21:43Z',
'fuel_type': 'petrol',
'id': '79eedd0f-420d-5877-a1ac-1dec1bd32d4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ42176',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 210584,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-27',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Saving data for AZ42176: {'auction_closing_time': 1774884103.0, 'created_time': 1773135092.266863, 'last_price_update_time': 1774809521.274613}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ42176') HTTP/1.1" 204 0
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for YK98725: 2
2026-03-29 18:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-29 18:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0b6d57-d74a-52e1-8c56-947ccc99826a with scrape type 2
2026-03-29 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a0b6d57-d74a-52e1-8c56-947ccc99826a with scrape type 2
2026-03-29 18:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a0b6d57-d74a-52e1-8c56-947ccc99826a, identifier: YK98725
2026-03-29 18:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-29 18:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-29 18:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725 to the API
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:04:49Z',
'fuel_type': 'petrol',
'id': '7a0b6d57-d74a-52e1-8c56-947ccc99826a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK98725',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 38839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Saving data for YK98725: {'auction_closing_time': 1774883089.0, 'created_time': 1773401270.60782, 'last_price_update_time': 1774809521.739629}
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK98725') HTTP/1.1" 204 0
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ89642%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for NZ89642: 0
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79272%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for JM79272: 0
2026-03-29 18:38:41 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-29 18:38:41 [auto1.de] INFO: Scrape type for KF96010: 2
2026-03-29 18:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-29 18:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with scrape type 2
2026-03-29 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21, identifier: KF96010
2026-03-29 18:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-29 18:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-29 18:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010 to the API
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 326,
'expiration_date': '2026-03-30T15:09:40Z',
'fuel_type': 'hybrid',
'id': '96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF96010',
'listing': 'auction',
'make': 'BMW',
'model': '7er',
'odometer': 61499,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-22',
'seller_name': None,
'title': 'BMW 7er 740e L',
'transmission': 'automatic',
'trim': 'L',
'year': 2017}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Saving data for KF96010: {'auction_closing_time': 1774883380.0, 'created_time': 1773308230.26714, 'last_price_update_time': 1774809522.317981}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF96010') HTTP/1.1" 204 0
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-29 18:38:42 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for UA99950: 2
2026-03-29 18:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-29 18:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05bba50-ef86-5855-bfcb-1a0f73147370 with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05bba50-ef86-5855-bfcb-1a0f73147370 with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05bba50-ef86-5855-bfcb-1a0f73147370, identifier: UA99950
2026-03-29 18:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-29 18:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-29 18:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950 to the API
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:21:20Z',
'fuel_type': 'diesel',
'id': 'd05bba50-ef86-5855-bfcb-1a0f73147370',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA99950',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 265743,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-21',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Saving data for UA99950: {'auction_closing_time': 1774884080.0, 'created_time': 1773429101.222429, 'last_price_update_time': 1774809522.796081}
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA99950') HTTP/1.1" 204 0
2026-03-29 18:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for PP83297: 0
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-29 18:38:42 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-29 18:38:42 [auto1.de] INFO: Scrape type for VT53198: 2
2026-03-29 18:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-29 18:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with scrape type 2
2026-03-29 18:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48, identifier: VT53198
2026-03-29 18:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-29 18:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-29 18:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198 to the API
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:30Z',
'fuel_type': 'diesel',
'id': '5b6e3121-8dbd-5e1c-a140-0b9930acfd48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT53198',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 159952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-12',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Saving data for VT53198: {'auction_closing_time': 1774885530.0, 'created_time': 1774608666.337759, 'last_price_update_time': 1774809523.38531}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT53198') HTTP/1.1" 204 0
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL92267%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Scrape type for EL92267: 0
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Scrape type for RK12981: 2
2026-03-29 18:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-29 18:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33, identifier: RK12981
2026-03-29 18:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-29 18:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-29 18:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981 to the API
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:36:51Z',
'fuel_type': 'petrol',
'id': 'ac52cc4a-fe0a-50d3-9738-c9adc27c3b33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK12981',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 132872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-25',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Saving data for RK12981: {'auction_closing_time': 1774885011.0, 'created_time': 1773345944.381472, 'last_price_update_time': 1774809523.853348}
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK12981') HTTP/1.1" 204 0
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-29 18:38:43 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-29 18:38:43 [auto1.de] INFO: Scrape type for JN95479: 2
2026-03-29 18:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-29 18:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed611637-6328-5e3c-bfde-f589840b163a with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed611637-6328-5e3c-bfde-f589840b163a with scrape type 2
2026-03-29 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed611637-6328-5e3c-bfde-f589840b163a, identifier: JN95479
2026-03-29 18:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-29 18:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-29 18:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479 to the API
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:37:11Z',
'fuel_type': 'diesel',
'id': 'ed611637-6328-5e3c-bfde-f589840b163a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN95479',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 188331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-26',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Saving data for JN95479: {'auction_closing_time': 1774885031.0, 'created_time': 1773136001.187482, 'last_price_update_time': 1774809524.388856}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN95479') HTTP/1.1" 204 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Scrape type for ES37621: 2
2026-03-29 18:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621
2026-03-29 18:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b424181-86cc-5c82-b76f-1526ec122d63 with scrape type 2
2026-03-29 18:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b424181-86cc-5c82-b76f-1526ec122d63 with scrape type 2
2026-03-29 18:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b424181-86cc-5c82-b76f-1526ec122d63, identifier: ES37621
2026-03-29 18:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-29 18:38:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621
2026-03-29 18:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b424181-86cc-5c82-b76f-1526ec122d63 with identifier: ES37621 to the API
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'other',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:53:36Z',
'fuel_type': 'hybrid',
'id': '1b424181-86cc-5c82-b76f-1526ec122d63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES37621',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 53726,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2022}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Saving data for ES37621: {'auction_closing_time': 1774886016.0, 'created_time': 1773345295.451001, 'last_price_update_time': 1774809524.936836}
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES37621') HTTP/1.1" 204 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77687%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Scrape type for HC77687: 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV67492%27 HTTP/1.1" 200 None
2026-03-29 18:38:44 [auto1.de] INFO: Scrape type for FV67492: 0
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-29 18:38:44 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for VC64340: 2
2026-03-29 18:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-29 18:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 228be84a-1d2d-5ff7-ada2-26968542c436 with scrape type 2
2026-03-29 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 228be84a-1d2d-5ff7-ada2-26968542c436 with scrape type 2
2026-03-29 18:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 228be84a-1d2d-5ff7-ada2-26968542c436, identifier: VC64340
2026-03-29 18:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-29 18:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-29 18:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340 to the API
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:43:58Z',
'fuel_type': 'diesel',
'id': '228be84a-1d2d-5ff7-ada2-26968542c436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC64340',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 168868,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-23',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Saving data for VC64340: {'auction_closing_time': 1774885438.0, 'created_time': 1773383411.053913, 'last_price_update_time': 1774809525.422065}
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC64340') HTTP/1.1" 204 0
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-29 18:38:45 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-29 18:38:45 [auto1.de] INFO: Scrape type for DT94754: 2
2026-03-29 18:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-29 18:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with scrape type 2
2026-03-29 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with scrape type 2
2026-03-29 18:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b47c6fe8-8101-57d4-9b05-3ca720aff3e2, identifier: DT94754
2026-03-29 18:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-29 18:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-29 18:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754 to the API
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:51:14Z',
'fuel_type': 'diesel',
'id': 'b47c6fe8-8101-57d4-9b05-3ca720aff3e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT94754',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 98855,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-20',
'seller_name': None,
'title': 'Mercedes-Benz Citan 109 CDI Lang',
'transmission': 'manual',
'trim': 'Lang',
'year': 2014}
2026-03-29 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Saving data for DT94754: {'auction_closing_time': 1774885874.0, 'created_time': 1773380560.023934, 'last_price_update_time': 1774809526.00633}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT94754') HTTP/1.1" 204 0
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Scrape type for TX63688: 2
2026-03-29 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-29 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6328d2a1-39c1-5106-9e54-ce92a4d90535 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6328d2a1-39c1-5106-9e54-ce92a4d90535 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6328d2a1-39c1-5106-9e54-ce92a4d90535, identifier: TX63688
2026-03-29 18:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-29 18:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-29 18:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688 to the API
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:30:43Z',
'fuel_type': 'diesel',
'id': '6328d2a1-39c1-5106-9e54-ce92a4d90535',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX63688',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 77192,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-23',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'manual',
'trim': 'Allure Pack',
'year': 2021}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Saving data for TX63688: {'auction_closing_time': 1774884643.0, 'created_time': 1774607867.468872, 'last_price_update_time': 1774809526.454846}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX63688') HTTP/1.1" 204 0
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Scrape type for MR65343: 2
2026-03-29 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-29 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05888734-0499-5bc7-8d60-028692f55005 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05888734-0499-5bc7-8d60-028692f55005 with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05888734-0499-5bc7-8d60-028692f55005, identifier: MR65343
2026-03-29 18:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-29 18:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-29 18:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343 to the API
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:42:24Z',
'fuel_type': 'diesel',
'id': '05888734-0499-5bc7-8d60-028692f55005',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR65343',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 136717,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-18',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI Elegance 4Motion',
'transmission': 'automatic',
'trim': 'Elegance 4Motion',
'year': 2019}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Saving data for MR65343: {'auction_closing_time': 1774885344.0, 'created_time': 1773775244.873221, 'last_price_update_time': 1774809526.88922}
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR65343') HTTP/1.1" 204 0
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB36710%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Scrape type for DB36710: 0
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-29 18:38:46 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-29 18:38:46 [auto1.de] INFO: Scrape type for HK50070: 2
2026-03-29 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070
2026-03-29 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64126f43-58fa-512c-b655-e4dc8bdb427f with scrape type 2
2026-03-29 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64126f43-58fa-512c-b655-e4dc8bdb427f with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64126f43-58fa-512c-b655-e4dc8bdb427f, identifier: HK50070
2026-03-29 18:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070
2026-03-29 18:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070
2026-03-29 18:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64126f43-58fa-512c-b655-e4dc8bdb427f with identifier: HK50070 to the API
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:23:55Z',
'fuel_type': 'diesel',
'id': '64126f43-58fa-512c-b655-e4dc8bdb427f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK50070',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix55',
'odometer': 294582,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-04',
'seller_name': None,
'title': 'Hyundai ix55 3.0 V6 CRDi Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2009}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Saving data for HK50070: {'auction_closing_time': 1774884235.0, 'created_time': 1773228108.430564, 'last_price_update_time': 1774809527.312082}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK50070') HTTP/1.1" 204 0
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Scrape type for SU14525: 2
2026-03-29 18:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-29 18:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96cac54-aefd-5e54-a0a7-2b702bfc4abe, identifier: SU14525
2026-03-29 18:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-29 18:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-29 18:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525 to the API
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:22:57Z',
'fuel_type': 'diesel',
'id': 'c96cac54-aefd-5e54-a0a7-2b702bfc4abe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU14525',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 71243,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-24',
'seller_name': None,
'title': 'Renault Master 2.3 dCi Energy L2H1 3,5t',
'transmission': 'manual',
'trim': 'L2H1 3,5t',
'year': 2018}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Saving data for SU14525: {'auction_closing_time': 1774884177.0, 'created_time': 1774607965.374403, 'last_price_update_time': 1774809527.784178}
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU14525') HTTP/1.1" 204 0
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD56647%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Scrape type for CD56647: 0
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-29 18:38:47 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-29 18:38:47 [auto1.de] INFO: Scrape type for KP48554: 2
2026-03-29 18:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-29 18:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with scrape type 2
2026-03-29 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6, identifier: KP48554
2026-03-29 18:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-29 18:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-29 18:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554 to the API
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:51:21Z',
'fuel_type': 'diesel',
'id': '50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP48554',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 201949,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-27',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2011}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Saving data for KP48554: {'auction_closing_time': 1774885881.0, 'created_time': 1774607891.335144, 'last_price_update_time': 1774809528.373798}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP48554') HTTP/1.1" 204 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for AY74749: 0
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for JJ83769: 2
2026-03-29 18:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-29 18:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc, identifier: JJ83769
2026-03-29 18:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-29 18:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-29 18:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769 to the API
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:20:39Z',
'fuel_type': 'diesel',
'id': '8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ83769',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 227076,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-08',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Saving data for JJ83769: {'auction_closing_time': 1774884039.0, 'created_time': 1773775704.465636, 'last_price_update_time': 1774809528.908695}
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ83769') HTTP/1.1" 204 0
2026-03-29 18:38:48 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-29 18:38:48 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-29 18:38:48 [auto1.de] INFO: Scrape type for RZ99970: 2
2026-03-29 18:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-29 18:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with scrape type 2
2026-03-29 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with scrape type 2
2026-03-29 18:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111, identifier: RZ99970
2026-03-29 18:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-29 18:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-29 18:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970 to the API
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:09:13Z',
'fuel_type': 'petrol',
'id': '9f3d696f-5c7b-50cb-bc2b-0f66a171c111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ99970',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 124070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-09',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Saving data for RZ99970: {'auction_closing_time': 1774883353.0, 'created_time': 1774608365.526383, 'last_price_update_time': 1774809529.358558}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ99970') HTTP/1.1" 204 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for SD32112: 2
2026-03-29 18:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-29 18:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with scrape type 2
2026-03-29 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with scrape type 2
2026-03-29 18:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4, identifier: SD32112
2026-03-29 18:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-29 18:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112
2026-03-29 18:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba08164a-5096-5f5d-9ef4-a1ab7885dfc4 with identifier: SD32112 to the API
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:22:40Z',
'fuel_type': 'petrol',
'id': 'ba08164a-5096-5f5d-9ef4-a1ab7885dfc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD32112',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 95218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-30',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Active Colourline',
'transmission': 'manual',
'trim': 'Active Colourline',
'year': 2019}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Saving data for SD32112: {'auction_closing_time': 1774884160.0, 'created_time': 1773945524.213484, 'last_price_update_time': 1774809529.895613}
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD32112') HTTP/1.1" 204 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-29 18:38:49 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-29 18:38:49 [auto1.de] INFO: Scrape type for HR96195: 2
2026-03-29 18:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-29 18:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8156d24a-632f-5b4e-8099-b781be3d8eb2 with scrape type 2
2026-03-29 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8156d24a-632f-5b4e-8099-b781be3d8eb2 with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8156d24a-632f-5b4e-8099-b781be3d8eb2, identifier: HR96195
2026-03-29 18:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-29 18:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-29 18:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195 to the API
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:37:58Z',
'fuel_type': 'petrol',
'id': '8156d24a-632f-5b4e-8099-b781be3d8eb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR96195',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 20118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-07',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Saving data for HR96195: {'auction_closing_time': 1774885078.0, 'created_time': 1774292457.00928, 'last_price_update_time': 1774809530.447957}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR96195') HTTP/1.1" 204 0
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-29 18:38:50 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Scrape type for VH10355: 2
2026-03-29 18:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-29 18:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ff7c2b-7573-5561-bfb9-331d69ba5436 with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ff7c2b-7573-5561-bfb9-331d69ba5436 with scrape type 2
2026-03-29 18:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ff7c2b-7573-5561-bfb9-331d69ba5436, identifier: VH10355
2026-03-29 18:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-29 18:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-29 18:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355 to the API
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:37:16Z',
'fuel_type': 'diesel',
'id': '02ff7c2b-7573-5561-bfb9-331d69ba5436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH10355',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 136448,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-18',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'automatic',
'trim': 'Sports-Line AWD',
'year': 2012}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-29 18:38:50 [auto1.de] INFO: Saving data for VH10355: {'auction_closing_time': 1774885036.0, 'created_time': 1774607747.407943, 'last_price_update_time': 1774809530.911052}
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH10355') HTTP/1.1" 204 0
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Scrape type for RA54991: 2
2026-03-29 18:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-29 18:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd7697d-1a2c-541b-98f2-466444732b31 with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd7697d-1a2c-541b-98f2-466444732b31 with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fd7697d-1a2c-541b-98f2-466444732b31, identifier: RA54991
2026-03-29 18:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-29 18:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-29 18:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991 to the API
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:52:43Z',
'fuel_type': 'petrol',
'id': '7fd7697d-1a2c-541b-98f2-466444732b31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA54991',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 96079,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-30',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2016}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Saving data for RA54991: {'auction_closing_time': 1774885963.0, 'created_time': 1774607844.146742, 'last_price_update_time': 1774809531.462013}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA54991') HTTP/1.1" 204 0
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Scrape type for MJ60689: 2
2026-03-29 18:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-29 18:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2118a9bc-558a-520a-a7f0-d34c6377ae8c with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2118a9bc-558a-520a-a7f0-d34c6377ae8c with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2118a9bc-558a-520a-a7f0-d34c6377ae8c, identifier: MJ60689
2026-03-29 18:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-29 18:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-29 18:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689 to the API
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:27:56Z',
'fuel_type': 'diesel',
'id': '2118a9bc-558a-520a-a7f0-d34c6377ae8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ60689',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 214351,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-09',
'seller_name': None,
'title': 'BMW X5 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Saving data for MJ60689: {'auction_closing_time': 1774884476.0, 'created_time': 1773830340.42552, 'last_price_update_time': 1774809531.945631}
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ60689') HTTP/1.1" 204 0
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-29 18:38:51 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-29 18:38:51 [auto1.de] INFO: Scrape type for ED74506: 2
2026-03-29 18:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-29 18:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with scrape type 2
2026-03-29 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd, identifier: ED74506
2026-03-29 18:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-29 18:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-29 18:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506 to the API
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:33:09Z',
'fuel_type': 'petrol',
'id': '5c4dea7a-2c50-5334-a5b0-26b2400eabdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED74506',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 172690,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-18',
'seller_name': None,
'title': 'Audi A5 2.0 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Saving data for ED74506: {'auction_closing_time': 1774884789.0, 'created_time': 1774263626.30485, 'last_price_update_time': 1774809532.400223}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED74506') HTTP/1.1" 204 0
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Scrape type for DP29257: 2
2026-03-29 18:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-29 18:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84c9788e-a100-5c3f-a035-b8bc1364dbcd, identifier: DP29257
2026-03-29 18:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-29 18:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-29 18:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257 to the API
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:07:21Z',
'fuel_type': 'diesel',
'id': '84c9788e-a100-5c3f-a035-b8bc1364dbcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP29257',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 182968,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-11',
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Saving data for DP29257: {'auction_closing_time': 1774883241.0, 'created_time': 1774608605.37909, 'last_price_update_time': 1774809532.83219}
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP29257') HTTP/1.1" 204 0
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-29 18:38:52 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-29 18:38:52 [auto1.de] INFO: Scrape type for UJ12211: 2
2026-03-29 18:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-29 18:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4166ded8-a037-5444-9372-94f93340ebbe with scrape type 2
2026-03-29 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4166ded8-a037-5444-9372-94f93340ebbe with scrape type 2
2026-03-29 18:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4166ded8-a037-5444-9372-94f93340ebbe, identifier: UJ12211
2026-03-29 18:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-29 18:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-29 18:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211 to the API
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:42:21Z',
'fuel_type': 'petrol',
'id': '4166ded8-a037-5444-9372-94f93340ebbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ12211',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 149391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-18',
'seller_name': None,
'title': 'Renault Megane 2.0 BOSE Edition',
'transmission': 'automatic',
'trim': 'BOSE Edition',
'year': 2013}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Saving data for UJ12211: {'auction_closing_time': 1774885341.0, 'created_time': 1774265321.633389, 'last_price_update_time': 1774809533.412995}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ12211') HTTP/1.1" 204 0
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64599%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for PN64599: 0
2026-03-29 18:38:53 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 6740 | hits on page: 40
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP37775%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for NP37775: 0
2026-03-29 18:38:53 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Scrape type for CY44920: 2
2026-03-29 18:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-29 18:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051cef2e-b623-5c8c-9616-1169f7535060 with scrape type 2
2026-03-29 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 051cef2e-b623-5c8c-9616-1169f7535060 with scrape type 2
2026-03-29 18:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 051cef2e-b623-5c8c-9616-1169f7535060, identifier: CY44920
2026-03-29 18:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-29 18:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-29 18:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920 to the API
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:26:29Z',
'fuel_type': 'diesel',
'id': '051cef2e-b623-5c8c-9616-1169f7535060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY44920',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 172904,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-01',
'seller_name': None,
'title': 'Volvo V90 2.0 D4 Inscription',
'transmission': 'automatic',
'trim': 'Inscription',
'year': 2018}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-29 18:38:53 [auto1.de] INFO: Saving data for CY44920: {'auction_closing_time': 1774884389.0, 'created_time': 1774608733.908771, 'last_price_update_time': 1774809533.941733}
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY44920') HTTP/1.1" 204 0
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Scrape type for NG80154: 2
2026-03-29 18:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-29 18:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cef325-c250-5e42-b342-b0497a60b29d with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1cef325-c250-5e42-b342-b0497a60b29d with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1cef325-c250-5e42-b342-b0497a60b29d, identifier: NG80154
2026-03-29 18:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-29 18:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-29 18:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154 to the API
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:09:37Z',
'fuel_type': 'diesel',
'id': 'a1cef325-c250-5e42-b342-b0497a60b29d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG80154',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 104165,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-20',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline Blue',
'transmission': 'manual',
'trim': 'Comfortline Blue',
'year': 2014}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Saving data for NG80154: {'auction_closing_time': 1774883377.0, 'created_time': 1774608254.86509, 'last_price_update_time': 1774809534.497103}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG80154') HTTP/1.1" 204 0
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Scrape type for UR14264: 0
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Scrape type for AC69838: 2
2026-03-29 18:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-29 18:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae, identifier: AC69838
2026-03-29 18:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-29 18:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838
2026-03-29 18:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae with identifier: AC69838 to the API
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:16:24Z',
'fuel_type': 'petrol',
'id': '4bc8ba95-fbf4-5f49-ad82-83b24d0f20ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC69838',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 201671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-30',
'seller_name': None,
'title': 'Audi A4 1.8 TFSI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2011}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Saving data for AC69838: {'auction_closing_time': 1774883784.0, 'created_time': 1774522242.16, 'last_price_update_time': 1774809534.910323}
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC69838') HTTP/1.1" 204 0
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-29 18:38:54 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-29 18:38:54 [auto1.de] INFO: Scrape type for VE16712: 2
2026-03-29 18:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-29 18:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with scrape type 2
2026-03-29 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5746afbe-8f5f-5d3c-90e8-a86f2a105410, identifier: VE16712
2026-03-29 18:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-29 18:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-29 18:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712 to the API
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:10Z',
'fuel_type': 'petrol',
'id': '5746afbe-8f5f-5d3c-90e8-a86f2a105410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE16712',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 84759,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-25',
'seller_name': None,
'title': 'Seat Ateca 1.5 TSI ACT Xcellence',
'transmission': 'manual',
'trim': 'Xcellence',
'year': 2020}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Saving data for VE16712: {'auction_closing_time': 1774886290.0, 'created_time': 1774290946.965932, 'last_price_update_time': 1774809535.37967}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE16712') HTTP/1.1" 204 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for JM07569: 2
2026-03-29 18:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569
2026-03-29 18:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee199af2-c46c-5adc-95f4-dc8e250ec1a6, identifier: JM07569
2026-03-29 18:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569
2026-03-29 18:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569
2026-03-29 18:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee199af2-c46c-5adc-95f4-dc8e250ec1a6 with identifier: JM07569 to the API
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:51:18Z',
'fuel_type': 'diesel',
'id': 'ee199af2-c46c-5adc-95f4-dc8e250ec1a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM07569',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 233291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-18',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2012}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Saving data for JM07569: {'auction_closing_time': 1774885878.0, 'created_time': 1774636610.829249, 'last_price_update_time': 1774809535.861922}
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM07569') HTTP/1.1" 204 0
2026-03-29 18:38:55 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-29 18:38:55 [auto1.de] INFO: Scrape type for JG35367: 2
2026-03-29 18:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-29 18:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ada5c644-2419-50f4-b949-34d24b688f4a with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ada5c644-2419-50f4-b949-34d24b688f4a with scrape type 2
2026-03-29 18:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ada5c644-2419-50f4-b949-34d24b688f4a, identifier: JG35367
2026-03-29 18:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-29 18:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367
2026-03-29 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ada5c644-2419-50f4-b949-34d24b688f4a with identifier: JG35367 to the API
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:34:25Z',
'fuel_type': 'diesel',
'id': 'ada5c644-2419-50f4-b949-34d24b688f4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35367',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 94727,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-22',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2016}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Saving data for JG35367: {'auction_closing_time': 1774884865.0, 'created_time': 1774522444.803613, 'last_price_update_time': 1774809536.266068}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35367') HTTP/1.1" 204 0
2026-03-29 18:38:56 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Scrape type for UR98494: 0
2026-03-29 18:38:56 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-29 18:38:56 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Scrape type for XJ52823: 2
2026-03-29 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-29 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6bddd6e-1259-5bc5-ae10-973b2dccc634 with scrape type 2
2026-03-29 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6bddd6e-1259-5bc5-ae10-973b2dccc634 with scrape type 2
2026-03-29 18:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6bddd6e-1259-5bc5-ae10-973b2dccc634, identifier: XJ52823
2026-03-29 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-29 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823 to the API
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:34:36Z',
'fuel_type': 'gas',
'id': 'f6bddd6e-1259-5bc5-ae10-973b2dccc634',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ52823',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 128182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-14',
'seller_name': None,
'title': 'Opel Combo 1.6 Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2007}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Saving data for XJ52823: {'auction_closing_time': 1774884876.0, 'created_time': 1773134420.851467, 'last_price_update_time': 1774809536.889696}
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ52823') HTTP/1.1" 204 0
2026-03-29 18:38:56 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-29 18:38:56 [auto1.de] INFO: Scrape type for GU30537: 2
2026-03-29 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-29 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f20a95-fc35-532b-adcb-a222c15e6a67 with scrape type 2
2026-03-29 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77f20a95-fc35-532b-adcb-a222c15e6a67 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77f20a95-fc35-532b-adcb-a222c15e6a67, identifier: GU30537
2026-03-29 18:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-29 18:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-29 18:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537 to the API
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:50:52Z',
'fuel_type': 'petrol',
'id': '77f20a95-fc35-532b-adcb-a222c15e6a67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU30537',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 162304,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-18',
'seller_name': None,
'title': 'Opel Zafira 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2007}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Saving data for GU30537: {'auction_closing_time': 1774885852.0, 'created_time': 1773134912.862582, 'last_price_update_time': 1774809537.370323}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU30537') HTTP/1.1" 204 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for CC57472: 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for YY13521: 2
2026-03-29 18:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-29 18:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d90399d-4d6a-5ce4-9639-e6435a8cb023, identifier: YY13521
2026-03-29 18:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-29 18:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-29 18:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521 to the API
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:55:25Z',
'fuel_type': 'diesel',
'id': '8d90399d-4d6a-5ce4-9639-e6435a8cb023',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY13521',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 169283,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-01',
'seller_name': None,
'title': 'Hyundai ix35 2.0 CRDi Go-Plus 4WD',
'transmission': 'automatic',
'trim': 'Go-Plus 4WD',
'year': 2014}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Saving data for YY13521: {'auction_closing_time': 1774886125.0, 'created_time': 1774607892.469515, 'last_price_update_time': 1774809537.834854}
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY13521') HTTP/1.1" 204 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00695%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for BU00695: 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH30720%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for GH30720: 0
2026-03-29 18:38:57 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-29 18:38:57 [auto1.de] INFO: Scrape type for ER31380: 2
2026-03-29 18:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380
2026-03-29 18:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8133f888-b442-5585-8cfd-404b082ecf78 with scrape type 2
2026-03-29 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8133f888-b442-5585-8cfd-404b082ecf78 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8133f888-b442-5585-8cfd-404b082ecf78, identifier: ER31380
2026-03-29 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380
2026-03-29 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380
2026-03-29 18:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8133f888-b442-5585-8cfd-404b082ecf78 with identifier: ER31380 to the API
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:36:18Z',
'fuel_type': 'petrol',
'id': '8133f888-b442-5585-8cfd-404b082ecf78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER31380',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 98889,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-11',
'seller_name': None,
'title': 'Opel Astra 1.0 Turbo Edition Start/Stop',
'transmission': 'manual',
'trim': 'Edition Start/Stop',
'year': 2016}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Saving data for ER31380: {'auction_closing_time': 1774884978.0, 'created_time': 1774636595.897083, 'last_price_update_time': 1774809538.293782}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER31380') HTTP/1.1" 204 0
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for CJ94642: 2
2026-03-29 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-29 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6782bfd-9371-5a5e-9668-335f14764b8a with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6782bfd-9371-5a5e-9668-335f14764b8a with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6782bfd-9371-5a5e-9668-335f14764b8a, identifier: CJ94642
2026-03-29 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-29 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-29 18:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642 to the API
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:01:17Z',
'fuel_type': 'diesel',
'id': 'd6782bfd-9371-5a5e-9668-335f14764b8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ94642',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 217323,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Audi A1 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2011}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Saving data for CJ94642: {'auction_closing_time': 1774882877.0, 'created_time': 1773688146.343724, 'last_price_update_time': 1774809538.846495}
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ94642') HTTP/1.1" 204 0
2026-03-29 18:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16745%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for WF16745: 0
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-29 18:38:58 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-29 18:38:58 [auto1.de] INFO: Scrape type for ZP86837: 2
2026-03-29 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-29 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 085ceaf3-cddf-54c6-b445-9790d7063277 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 085ceaf3-cddf-54c6-b445-9790d7063277 with scrape type 2
2026-03-29 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 085ceaf3-cddf-54c6-b445-9790d7063277, identifier: ZP86837
2026-03-29 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-29 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-29 18:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837 to the API
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:29:54Z',
'fuel_type': 'diesel',
'id': '085ceaf3-cddf-54c6-b445-9790d7063277',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP86837',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 43102,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-29 18:38:59 [auto1.de] INFO: Saving data for ZP86837: {'auction_closing_time': 1774884594.0, 'created_time': 1774607834.379843, 'last_price_update_time': 1774809539.873018}
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP86837') HTTP/1.1" 204 0
2026-03-29 18:38:59 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-29 18:38:59 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-29 18:38:59 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-29 18:38:59 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-29 18:38:59 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-29 18:38:59 [auto1.de] INFO: Scrape type for SR15436: 2
2026-03-29 18:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-29 18:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039c0a14-9801-5631-9175-8fbdb9cb9c4f with scrape type 2
2026-03-29 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039c0a14-9801-5631-9175-8fbdb9cb9c4f with scrape type 2
2026-03-29 18:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039c0a14-9801-5631-9175-8fbdb9cb9c4f, identifier: SR15436
2026-03-29 18:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-29 18:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-29 18:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436 to the API
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:22:19Z',
'fuel_type': 'diesel',
'id': '039c0a14-9801-5631-9175-8fbdb9cb9c4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR15436',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 149497,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 d T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2019}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Saving data for SR15436: {'auction_closing_time': 1774884139.0, 'created_time': 1773402586.172188, 'last_price_update_time': 1774809540.451359}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR15436') HTTP/1.1" 204 0
2026-03-29 18:39:00 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-29 18:39:00 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Scrape type for UC84662: 2
2026-03-29 18:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-29 18:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 690a8572-9671-584a-9f20-74789ae9bec4 with scrape type 2
2026-03-29 18:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 690a8572-9671-584a-9f20-74789ae9bec4 with scrape type 2
2026-03-29 18:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 690a8572-9671-584a-9f20-74789ae9bec4, identifier: UC84662
2026-03-29 18:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-29 18:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-29 18:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662 to the API
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:13:22Z',
'fuel_type': 'hybrid',
'id': '690a8572-9671-584a-9f20-74789ae9bec4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC84662',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 115269,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-14',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-29 18:39:00 [auto1.de] INFO: Saving data for UC84662: {'auction_closing_time': 1774883602.0, 'created_time': 1774290998.447253, 'last_price_update_time': 1774809540.978021}
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC84662') HTTP/1.1" 204 0
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for SW57264: 0
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for DF45808: 2
2026-03-29 18:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-29 18:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with scrape type 2
2026-03-29 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with scrape type 2
2026-03-29 18:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f, identifier: DF45808
2026-03-29 18:39:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-29 18:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-29 18:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808 to the API
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:45:06Z',
'fuel_type': 'diesel',
'id': '875dfa3d-a4a6-527f-be7f-46ae90a5ed3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF45808',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 272344,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-06',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI R-Line Edition',
'transmission': 'automatic',
'trim': 'R-Line Edition',
'year': 2009}
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Saving data for DF45808: {'auction_closing_time': 1774885506.0, 'created_time': 1773401295.068261, 'last_price_update_time': 1774809541.907903}
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF45808') HTTP/1.1" 204 0
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for PH27110: 0
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91695%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for FT91695: 0
2026-03-29 18:39:01 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-29 18:39:01 [auto1.de] INFO: Scrape type for VV46432: 2
2026-03-29 18:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-29 18:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with scrape type 2
2026-03-29 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a, identifier: VV46432
2026-03-29 18:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-29 18:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-29 18:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432 to the API
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:54:08Z',
'fuel_type': 'petrol',
'id': '125ad95c-e2f3-5f4a-9884-95b2a29e5c4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV46432',
'listing': 'auction',
'make': 'Audi',
'model': 'S5',
'odometer': 4925,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-08-13',
'seller_name': None,
'title': 'Audi S5 3.0 TFSI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2024}
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Saving data for VV46432: {'auction_closing_time': 1774886048.0, 'created_time': 1774608076.490126, 'last_price_update_time': 1774809542.430017}
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV46432') HTTP/1.1" 204 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ26339%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for SJ26339: 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for WK97473: 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG38985%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for VG38985: 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN99491%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for SN99491: 0
2026-03-29 18:39:02 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Scrape type for RM44288: 2
2026-03-29 18:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-29 18:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7dadd69-4268-5386-bb11-a9fc32343992 with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7dadd69-4268-5386-bb11-a9fc32343992 with scrape type 2
2026-03-29 18:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7dadd69-4268-5386-bb11-a9fc32343992, identifier: RM44288
2026-03-29 18:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-29 18:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288
2026-03-29 18:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7dadd69-4268-5386-bb11-a9fc32343992 with identifier: RM44288 to the API
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:22:36Z',
'fuel_type': 'diesel',
'id': 'c7dadd69-4268-5386-bb11-a9fc32343992',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM44288',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 224714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-16',
'seller_name': None,
'title': 'Audi A4 3.0 V6 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-29 18:39:02 [auto1.de] INFO: Saving data for RM44288: {'auction_closing_time': 1774884156.0, 'created_time': 1774521588.523144, 'last_price_update_time': 1774809542.939276}
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM44288') HTTP/1.1" 204 0
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Scrape type for EG39576: 2
2026-03-29 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-29 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f2292a-f4d8-5729-99d8-caa5d157734e with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f2292a-f4d8-5729-99d8-caa5d157734e with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36f2292a-f4d8-5729-99d8-caa5d157734e, identifier: EG39576
2026-03-29 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-29 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-29 18:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576 to the API
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:33:32Z',
'fuel_type': 'diesel',
'id': '36f2292a-f4d8-5729-99d8-caa5d157734e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG39576',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 229839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-11',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition 4x4',
'transmission': 'automatic',
'trim': 'Ambition 4x4',
'year': 2018}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Saving data for EG39576: {'auction_closing_time': 1774884812.0, 'created_time': 1773861470.681562, 'last_price_update_time': 1774809543.484552}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG39576') HTTP/1.1" 204 0
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Scrape type for FL12267: 2
2026-03-29 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-29 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d317abd7-0a52-5f1c-9142-0091822e1c18 with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d317abd7-0a52-5f1c-9142-0091822e1c18 with scrape type 2
2026-03-29 18:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d317abd7-0a52-5f1c-9142-0091822e1c18, identifier: FL12267
2026-03-29 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-29 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-29 18:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267 to the API
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:50:18Z',
'fuel_type': 'petrol',
'id': 'd317abd7-0a52-5f1c-9142-0091822e1c18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL12267',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 176906,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Saving data for FL12267: {'auction_closing_time': 1774885818.0, 'created_time': 1773303651.843904, 'last_price_update_time': 1774809543.938677}
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL12267') HTTP/1.1" 204 0
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY92753%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Scrape type for PY92753: 0
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-29 18:39:03 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-29 18:39:03 [auto1.de] INFO: Scrape type for RZ52630: 2
2026-03-29 18:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-29 18:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1795d8cc-6e31-5450-a9fe-2de425f44477 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1795d8cc-6e31-5450-a9fe-2de425f44477 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1795d8cc-6e31-5450-a9fe-2de425f44477, identifier: RZ52630
2026-03-29 18:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-29 18:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-29 18:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630 to the API
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:23:37Z',
'fuel_type': 'petrol',
'id': '1795d8cc-6e31-5450-a9fe-2de425f44477',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ52630',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 263004,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-04-25',
'seller_name': None,
'title': 'Volvo V70 2.4 R',
'transmission': 'manual',
'trim': '',
'year': 2000}
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Saving data for RZ52630: {'auction_closing_time': 1774884217.0, 'created_time': 1774291891.655727, 'last_price_update_time': 1774809544.455141}
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ52630') HTTP/1.1" 204 0
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Scrape type for LJ04369: 0
2026-03-29 18:39:04 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-29 18:39:04 [auto1.de] INFO: Scrape type for SD72223: 2
2026-03-29 18:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-29 18:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with scrape type 2
2026-03-29 18:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4, identifier: SD72223
2026-03-29 18:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-29 18:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-29 18:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223 to the API
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:32Z',
'fuel_type': 'petrol',
'id': '8cef0cdd-d5af-5f11-82bd-d2799e0558a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD72223',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 36920,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-28',
'seller_name': None,
'title': 'Renault Clio 1.2 Campus Authentique',
'transmission': 'manual',
'trim': 'Campus Authentique',
'year': 2009}
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Saving data for SD72223: {'auction_closing_time': 1774884872.0, 'created_time': 1774608189.655334, 'last_price_update_time': 1774809545.251538}
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD72223') HTTP/1.1" 204 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU53159%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for FU53159: 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX37368%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for JX37368: 0
2026-03-29 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:05 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-29 18:39:05 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-29 18:39:05 [auto1.de] INFO: Scrape type for YP91741: 2
2026-03-29 18:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-29 18:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with scrape type 2
2026-03-29 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with scrape type 2
2026-03-29 18:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef9df5d1-7f25-529c-a24c-f92f72dae2c3, identifier: YP91741
2026-03-29 18:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-29 18:39:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-29 18:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741 to the API
2026-03-29 18:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:21:23Z',
'fuel_type': 'petrol',
'id': 'ef9df5d1-7f25-529c-a24c-f92f72dae2c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP91741',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 82020,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-14',
'seller_name': None,
'title': 'BMW 3er 318i',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Saving data for YP91741: {'auction_closing_time': 1774884083.0, 'created_time': 1774608236.491665, 'last_price_update_time': 1774809546.209425}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP91741') HTTP/1.1" 204 0
2026-03-29 18:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:06 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Scrape type for BP81340: 2
2026-03-29 18:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340
2026-03-29 18:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b41a123c-e89b-5dbd-af01-63be3ca46c37 with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b41a123c-e89b-5dbd-af01-63be3ca46c37 with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b41a123c-e89b-5dbd-af01-63be3ca46c37, identifier: BP81340
2026-03-29 18:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340
2026-03-29 18:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340
2026-03-29 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b41a123c-e89b-5dbd-af01-63be3ca46c37 with identifier: BP81340 to the API
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 367,
'expiration_date': '2026-03-30T15:15:58Z',
'fuel_type': 'petrol',
'id': 'b41a123c-e89b-5dbd-af01-63be3ca46c37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP81340',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 200208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-30',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 43 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2017}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Saving data for BP81340: {'auction_closing_time': 1774883758.0, 'created_time': 1773917309.492338, 'last_price_update_time': 1774809546.716881}
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP81340') HTTP/1.1" 204 0
2026-03-29 18:39:06 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-29 18:39:06 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-29 18:39:06 [auto1.de] INFO: Scrape type for DF63833: 2
2026-03-29 18:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-29 18:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed48b641-bcbe-5e87-81c0-2a01c90703b8 with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed48b641-bcbe-5e87-81c0-2a01c90703b8 with scrape type 2
2026-03-29 18:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed48b641-bcbe-5e87-81c0-2a01c90703b8, identifier: DF63833
2026-03-29 18:39:06 [scrapy.extensions.logstats] INFO: Crawled 53 pages (at 10 pages/min), scraped 330 items (at 95 items/min)
2026-03-29 18:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-29 18:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-29 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833 to the API
2026-03-29 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:12:37Z',
'fuel_type': 'diesel',
'id': 'ed48b641-bcbe-5e87-81c0-2a01c90703b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF63833',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 111776,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-01',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2020}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Saving data for DF63833: {'auction_closing_time': 1774883557.0, 'created_time': 1773383086.297877, 'last_price_update_time': 1774809547.271672}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF63833') HTTP/1.1" 204 0
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU39624%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Scrape type for FU39624: 0
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Scrape type for MU50288: 2
2026-03-29 18:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-29 18:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48c2b4a3-802d-59a1-8a39-6aea083e2e61, identifier: MU50288
2026-03-29 18:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-29 18:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288
2026-03-29 18:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48c2b4a3-802d-59a1-8a39-6aea083e2e61 with identifier: MU50288 to the API
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:46:01Z',
'fuel_type': 'petrol',
'id': '48c2b4a3-802d-59a1-8a39-6aea083e2e61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU50288',
'listing': 'auction',
'make': 'Dacia',
'model': 'Dokker',
'odometer': 84113,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-28',
'seller_name': None,
'title': 'Dacia Dokker 1.6 SCe Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2016}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Saving data for MU50288: {'auction_closing_time': 1774885561.0, 'created_time': 1773382817.353215, 'last_price_update_time': 1774809547.719967}
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU50288') HTTP/1.1" 204 0
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD59606%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Scrape type for UD59606: 0
2026-03-29 18:39:07 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-29 18:39:07 [auto1.de] INFO: Scrape type for SW83321: 2
2026-03-29 18:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-29 18:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9235e0f5-7147-52b3-8aac-80edc826c31e with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9235e0f5-7147-52b3-8aac-80edc826c31e with scrape type 2
2026-03-29 18:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9235e0f5-7147-52b3-8aac-80edc826c31e, identifier: SW83321
2026-03-29 18:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-29 18:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-29 18:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321 to the API
2026-03-29 18:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:18:54Z',
'fuel_type': 'diesel',
'id': '9235e0f5-7147-52b3-8aac-80edc826c31e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW83321',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 73295,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-02',
'seller_name': None,
'title': 'Seat Arona 1.6 TDI Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2020}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Saving data for SW83321: {'auction_closing_time': 1774883934.0, 'created_time': 1774034297.768809, 'last_price_update_time': 1774809548.194593}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW83321') HTTP/1.1" 204 0
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Scrape type for EM22494: 2
2026-03-29 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-29 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a1effc-b0de-5c9b-85c0-bf35fff7962e with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a1effc-b0de-5c9b-85c0-bf35fff7962e with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a1effc-b0de-5c9b-85c0-bf35fff7962e, identifier: EM22494
2026-03-29 18:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-29 18:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494
2026-03-29 18:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a1effc-b0de-5c9b-85c0-bf35fff7962e with identifier: EM22494 to the API
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:33:59Z',
'fuel_type': 'petrol',
'id': '29a1effc-b0de-5c9b-85c0-bf35fff7962e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM22494',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 143229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-30',
'seller_name': None,
'title': 'BMW 3er 328i GT xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Saving data for EM22494: {'auction_closing_time': 1774884839.0, 'created_time': 1774521552.554999, 'last_price_update_time': 1774809548.594967}
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM22494') HTTP/1.1" 204 0
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA37640%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Scrape type for PA37640: 0
2026-03-29 18:39:08 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-29 18:39:08 [auto1.de] INFO: Scrape type for MV18053: 2
2026-03-29 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-29 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 461a9b45-ae98-56f9-8454-d7329e490e6b with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 461a9b45-ae98-56f9-8454-d7329e490e6b with scrape type 2
2026-03-29 18:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 461a9b45-ae98-56f9-8454-d7329e490e6b, identifier: MV18053
2026-03-29 18:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-29 18:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-29 18:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053 to the API
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:52:40Z',
'fuel_type': 'petrol',
'id': '461a9b45-ae98-56f9-8454-d7329e490e6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV18053',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 115670,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-03',
'seller_name': None,
'title': 'Audi A5 2.0 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Saving data for MV18053: {'auction_closing_time': 1774885960.0, 'created_time': 1773812125.868679, 'last_price_update_time': 1774809549.068137}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV18053') HTTP/1.1" 204 0
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Scrape type for KA22944: 2
2026-03-29 18:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-29 18:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe7bf2c-8332-5993-a017-b632a06576a0 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe7bf2c-8332-5993-a017-b632a06576a0 with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffe7bf2c-8332-5993-a017-b632a06576a0, identifier: KA22944
2026-03-29 18:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-29 18:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-29 18:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944 to the API
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 207,
'expiration_date': '2026-03-30T15:04:41Z',
'fuel_type': 'petrol',
'id': 'ffe7bf2c-8332-5993-a017-b632a06576a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA22944',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 19724,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-21',
'seller_name': None,
'title': 'Audi A1 Sportback 40 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Saving data for KA22944: {'auction_closing_time': 1774883081.0, 'created_time': 1773302355.530143, 'last_price_update_time': 1774809549.605718}
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA22944') HTTP/1.1" 204 0
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Scrape type for PV27021: 0
2026-03-29 18:39:09 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-29 18:39:09 [auto1.de] INFO: Scrape type for AP27918: 2
2026-03-29 18:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-29 18:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d8ed02-68c0-584c-a6b9-9da3709cc07e with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93d8ed02-68c0-584c-a6b9-9da3709cc07e with scrape type 2
2026-03-29 18:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93d8ed02-68c0-584c-a6b9-9da3709cc07e, identifier: AP27918
2026-03-29 18:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-29 18:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-29 18:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918 to the API
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:38:41Z',
'fuel_type': 'petrol',
'id': '93d8ed02-68c0-584c-a6b9-9da3709cc07e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP27918',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 134961,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-28',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
'transmission': 'manual',
'trim': 'AMG Line',
'year': 2016}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Saving data for AP27918: {'auction_closing_time': 1774885121.0, 'created_time': 1773342116.085903, 'last_price_update_time': 1774809550.107847}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP27918') HTTP/1.1" 204 0
2026-03-29 18:39:10 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Scrape type for EZ35619: 2
2026-03-29 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619
2026-03-29 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e70f468-a440-5235-a96b-113d396091c2 with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e70f468-a440-5235-a96b-113d396091c2 with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e70f468-a440-5235-a96b-113d396091c2, identifier: EZ35619
2026-03-29 18:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619
2026-03-29 18:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619
2026-03-29 18:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619 to the API
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:57:50Z',
'fuel_type': 'petrol',
'id': '4e70f468-a440-5235-a96b-113d396091c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ35619',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 164611,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-10',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TSI Style 4x4',
'transmission': 'automatic',
'trim': 'Style 4x4',
'year': 2017}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Saving data for EZ35619: {'auction_closing_time': 1774886270.0, 'created_time': 1774510543.754366, 'last_price_update_time': 1774809550.583142}
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ35619') HTTP/1.1" 204 0
2026-03-29 18:39:10 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-29 18:39:10 [auto1.de] INFO: Scrape type for PK38056: 2
2026-03-29 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-29 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with scrape type 2
2026-03-29 18:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61, identifier: PK38056
2026-03-29 18:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-29 18:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-29 18:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056 to the API
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:37:45Z',
'fuel_type': 'petrol',
'id': '02ce3750-4fc2-521f-ab84-c34c1a9a7a61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK38056',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 231862,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-28',
'seller_name': None,
'title': 'Audi A4 1.8 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Saving data for PK38056: {'auction_closing_time': 1774885065.0, 'created_time': 1773861139.727464, 'last_price_update_time': 1774809551.035847}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK38056') HTTP/1.1" 204 0
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67029%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for HB67029: 0
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM08795%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for GM08795: 0
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for LR95574: 0
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-29 18:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:11 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for NZ25875: 2
2026-03-29 18:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-29 18:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with scrape type 2
2026-03-29 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with scrape type 2
2026-03-29 18:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a, identifier: NZ25875
2026-03-29 18:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-29 18:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875
2026-03-29 18:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 601e9cdd-97c9-525e-b7cf-7c4a8e449b2a with identifier: NZ25875 to the API
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:04Z',
'fuel_type': 'diesel',
'id': '601e9cdd-97c9-525e-b7cf-7c4a8e449b2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ25875',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 260732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-14',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Saving data for NZ25875: {'auction_closing_time': 1774885564.0, 'created_time': 1774521561.69777, 'last_price_update_time': 1774809551.609699}
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ25875') HTTP/1.1" 204 0
2026-03-29 18:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-29 18:39:11 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-29 18:39:11 [auto1.de] INFO: Scrape type for YU93919: 2
2026-03-29 18:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919
2026-03-29 18:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d38cf00-8821-5672-93b9-61bee1495ca9 with scrape type 2
2026-03-29 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d38cf00-8821-5672-93b9-61bee1495ca9 with scrape type 2
2026-03-29 18:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d38cf00-8821-5672-93b9-61bee1495ca9, identifier: YU93919
2026-03-29 18:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919
2026-03-29 18:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919
2026-03-29 18:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d38cf00-8821-5672-93b9-61bee1495ca9 with identifier: YU93919 to the API
2026-03-29 18:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:25:07Z',
'fuel_type': 'petrol',
'id': '1d38cf00-8821-5672-93b9-61bee1495ca9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU93919',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 82900,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-27',
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Saving data for YU93919: {'auction_closing_time': 1774884307.0, 'created_time': 1774636637.382297, 'last_price_update_time': 1774809552.12442}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU93919') HTTP/1.1" 204 0
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Scrape type for LG85121: 2
2026-03-29 18:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-29 18:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9585bbde-b3a0-52ac-929a-11474f11909b with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9585bbde-b3a0-52ac-929a-11474f11909b with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9585bbde-b3a0-52ac-929a-11474f11909b, identifier: LG85121
2026-03-29 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-29 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-29 18:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121 to the API
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:45:25Z',
'fuel_type': 'diesel',
'id': '9585bbde-b3a0-52ac-929a-11474f11909b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG85121',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 91626,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-31',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Energy BOSE-Edition',
'transmission': 'automatic',
'trim': 'BOSE-Edition',
'year': 2017}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Saving data for LG85121: {'auction_closing_time': 1774885525.0, 'created_time': 1773136202.743044, 'last_price_update_time': 1774809552.592229}
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG85121') HTTP/1.1" 204 0
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR11157%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Scrape type for YR11157: 0
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB39806%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Scrape type for XB39806: 0
2026-03-29 18:39:12 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-29 18:39:12 [auto1.de] INFO: Scrape type for TE25882: 2
2026-03-29 18:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-29 18:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with scrape type 2
2026-03-29 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e, identifier: TE25882
2026-03-29 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-29 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-29 18:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882 to the API
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:42:01Z',
'fuel_type': 'petrol',
'id': '9a58472f-dd8f-5a0c-88f0-5d45a91ba20e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE25882',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 173670,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-03',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Saving data for TE25882: {'auction_closing_time': 1774885321.0, 'created_time': 1772546331.785917, 'last_price_update_time': 1774809553.084958}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE25882') HTTP/1.1" 204 0
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Scrape type for LR74805: 0
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX03618%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Scrape type for MX03618: 0
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Scrape type for DC30039: 2
2026-03-29 18:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-29 18:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb25c12a-97b7-5649-ac29-b32a9302172d with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb25c12a-97b7-5649-ac29-b32a9302172d with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb25c12a-97b7-5649-ac29-b32a9302172d, identifier: DC30039
2026-03-29 18:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-29 18:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-29 18:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039 to the API
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:14:57Z',
'fuel_type': 'petrol',
'id': 'bb25c12a-97b7-5649-ac29-b32a9302172d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC30039',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 95401,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-16',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Saving data for DC30039: {'auction_closing_time': 1774883697.0, 'created_time': 1774608310.870023, 'last_price_update_time': 1774809553.55248}
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC30039') HTTP/1.1" 204 0
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-29 18:39:13 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-29 18:39:13 [auto1.de] INFO: Scrape type for JS29851: 2
2026-03-29 18:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-29 18:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with scrape type 2
2026-03-29 18:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7abbbe02-7b71-5312-a9dd-9c6332e77b83, identifier: JS29851
2026-03-29 18:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-29 18:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-29 18:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851 to the API
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:19:01Z',
'fuel_type': 'diesel',
'id': '7abbbe02-7b71-5312-a9dd-9c6332e77b83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS29851',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 295365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-28',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2011}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Saving data for JS29851: {'auction_closing_time': 1774883941.0, 'created_time': 1774294352.430586, 'last_price_update_time': 1774809554.091899}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS29851') HTTP/1.1" 204 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP20467%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for MP20467: 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for UK63954: 2
2026-03-29 18:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-29 18:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed63697-20ff-502a-a518-a6e3ed065080 with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed63697-20ff-502a-a518-a6e3ed065080 with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fed63697-20ff-502a-a518-a6e3ed065080, identifier: UK63954
2026-03-29 18:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-29 18:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954
2026-03-29 18:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fed63697-20ff-502a-a518-a6e3ed065080 with identifier: UK63954 to the API
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:49:48Z',
'fuel_type': 'diesel',
'id': 'fed63697-20ff-502a-a518-a6e3ed065080',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK63954',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 156224,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-27',
'seller_name': None,
'title': 'BMW 5er 540d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2018}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Saving data for UK63954: {'auction_closing_time': 1774885788.0, 'created_time': 1774522466.489692, 'last_price_update_time': 1774809554.598742}
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK63954') HTTP/1.1" 204 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for VM82441: 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for CF62011: 0
2026-03-29 18:39:14 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-29 18:39:14 [auto1.de] INFO: Scrape type for WF80406: 2
2026-03-29 18:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-29 18:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af86c294-3dc1-5bf4-888f-47e35863b310 with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af86c294-3dc1-5bf4-888f-47e35863b310 with scrape type 2
2026-03-29 18:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af86c294-3dc1-5bf4-888f-47e35863b310, identifier: WF80406
2026-03-29 18:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-29 18:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-29 18:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406 to the API
2026-03-29 18:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:33Z',
'fuel_type': 'petrol',
'id': 'af86c294-3dc1-5bf4-888f-47e35863b310',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF80406',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 66628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-01',
'seller_name': None,
'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
'transmission': 'automatic',
'trim': 'sport',
'year': 2018}
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Saving data for WF80406: {'auction_closing_time': 1774882893.0, 'created_time': 1773819327.018415, 'last_price_update_time': 1774809555.120884}
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF80406') HTTP/1.1" 204 0
2026-03-29 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92334%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for KC92334: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for FK07510: 2
2026-03-29 18:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510
2026-03-29 18:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with scrape type 2
2026-03-29 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with scrape type 2
2026-03-29 18:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30eb1c70-fef3-54e4-bdb6-dd67548bae53, identifier: FK07510
2026-03-29 18:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510
2026-03-29 18:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510
2026-03-29 18:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30eb1c70-fef3-54e4-bdb6-dd67548bae53 with identifier: FK07510 to the API
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:57:57Z',
'fuel_type': 'petrol',
'id': '30eb1c70-fef3-54e4-bdb6-dd67548bae53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK07510',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 343787,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-10-21',
'seller_name': None,
'title': 'BMW 3er 320Ci',
'transmission': 'manual',
'trim': '',
'year': 2002}
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Saving data for FK07510: {'auction_closing_time': 1774886277.0, 'created_time': 1773303037.949585, 'last_price_update_time': 1774809555.588956}
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK07510') HTTP/1.1" 204 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV15826%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for SV15826: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for ST87748: 0
2026-03-29 18:39:15 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for EY26571: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for WP86079: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL97595%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for DL97595: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for VE57105: 0
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-29 18:39:15 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-29 18:39:15 [auto1.de] INFO: Scrape type for CC99000: 2
2026-03-29 18:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-29 18:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da322c59-9334-52c4-a80a-21c9badf40d4 with scrape type 2
2026-03-29 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da322c59-9334-52c4-a80a-21c9badf40d4 with scrape type 2
2026-03-29 18:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da322c59-9334-52c4-a80a-21c9badf40d4, identifier: CC99000
2026-03-29 18:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-29 18:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000
2026-03-29 18:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da322c59-9334-52c4-a80a-21c9badf40d4 with identifier: CC99000 to the API
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:51:40Z',
'fuel_type': 'petrol',
'id': 'da322c59-9334-52c4-a80a-21c9badf40d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC99000',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 96033,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-26',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2010}
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Saving data for CC99000: {'auction_closing_time': 1774885900.0, 'created_time': 1774522187.993582, 'last_price_update_time': 1774809556.239735}
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC99000') HTTP/1.1" 204 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB25361%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for UB25361: 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63570%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for TN63570: 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for PX08843: 2
2026-03-29 18:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-29 18:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d, identifier: PX08843
2026-03-29 18:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-29 18:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-29 18:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843 to the API
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:50:40Z',
'fuel_type': 'petrol',
'id': '7b2d2639-29b2-5fcf-866b-4b898fdbe17d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX08843',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 20237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-23',
'seller_name': None,
'title': 'BMW 1er 118i Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2023}
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Saving data for PX08843: {'auction_closing_time': 1774885840.0, 'created_time': 1773861459.200383, 'last_price_update_time': 1774809556.812557}
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX08843') HTTP/1.1" 204 0
2026-03-29 18:39:16 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-29 18:39:16 [auto1.de] INFO: Scrape type for CB12842: 2
2026-03-29 18:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-29 18:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a03ca11-e6e7-514f-a307-38831f84618b with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a03ca11-e6e7-514f-a307-38831f84618b with scrape type 2
2026-03-29 18:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a03ca11-e6e7-514f-a307-38831f84618b, identifier: CB12842
2026-03-29 18:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-29 18:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-29 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842 to the API
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:56:45Z',
'fuel_type': 'petrol',
'id': '9a03ca11-e6e7-514f-a307-38831f84618b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB12842',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 187814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-17',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Saving data for CB12842: {'auction_closing_time': 1774886205.0, 'created_time': 1774608714.080222, 'last_price_update_time': 1774809557.259754}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB12842') HTTP/1.1" 204 0
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Scrape type for UG93766: 2
2026-03-29 18:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-29 18:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3222c970-a66b-53ff-a91c-54520670399b with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3222c970-a66b-53ff-a91c-54520670399b with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3222c970-a66b-53ff-a91c-54520670399b, identifier: UG93766
2026-03-29 18:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-29 18:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-29 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766 to the API
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:59:15Z',
'fuel_type': 'diesel',
'id': '3222c970-a66b-53ff-a91c-54520670399b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG93766',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i40',
'odometer': 274786,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-03',
'seller_name': None,
'title': 'Hyundai i40 1.7 CRDi FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2014}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Saving data for UG93766: {'auction_closing_time': 1774886355.0, 'created_time': 1773307900.243244, 'last_price_update_time': 1774809557.748957}
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG93766') HTTP/1.1" 204 0
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-29 18:39:17 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-29 18:39:17 [auto1.de] INFO: Scrape type for AL34551: 2
2026-03-29 18:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-29 18:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c12c7325-bbda-58aa-a7db-87bbba1fe59b with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c12c7325-bbda-58aa-a7db-87bbba1fe59b with scrape type 2
2026-03-29 18:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c12c7325-bbda-58aa-a7db-87bbba1fe59b, identifier: AL34551
2026-03-29 18:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-29 18:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551
2026-03-29 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c12c7325-bbda-58aa-a7db-87bbba1fe59b with identifier: AL34551 to the API
2026-03-29 18:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:51:56Z',
'fuel_type': 'petrol',
'id': 'c12c7325-bbda-58aa-a7db-87bbba1fe59b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL34551',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 112550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-26',
'seller_name': None,
'title': 'Renault Megane 1.2 BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2012}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Saving data for AL34551: {'auction_closing_time': 1774885916.0, 'created_time': 1774521556.467277, 'last_price_update_time': 1774809558.158108}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL34551') HTTP/1.1" 204 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for DL95499: 2
2026-03-29 18:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-29 18:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c248a85-2033-5e21-80c8-16b658fa9f0b with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c248a85-2033-5e21-80c8-16b658fa9f0b with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c248a85-2033-5e21-80c8-16b658fa9f0b, identifier: DL95499
2026-03-29 18:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-29 18:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-29 18:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499 to the API
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:23:56Z',
'fuel_type': 'diesel',
'id': '7c248a85-2033-5e21-80c8-16b658fa9f0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL95499',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 242886,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2014}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Saving data for DL95499: {'auction_closing_time': 1774884236.0, 'created_time': 1773830263.126836, 'last_price_update_time': 1774809558.620784}
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL95499') HTTP/1.1" 204 0
2026-03-29 18:39:18 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-29 18:39:18 [auto1.de] INFO: Scrape type for JB33429: 2
2026-03-29 18:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-29 18:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with scrape type 2
2026-03-29 18:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ea037ab-8aa6-5e60-963b-ffd280e343a9, identifier: JB33429
2026-03-29 18:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-29 18:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429
2026-03-29 18:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ea037ab-8aa6-5e60-963b-ffd280e343a9 with identifier: JB33429 to the API
2026-03-29 18:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:19:04Z',
'fuel_type': 'petrol',
'id': '9ea037ab-8aa6-5e60-963b-ffd280e343a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB33429',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 51287,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-20',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Experience',
'transmission': 'automatic',
'trim': 'Experience',
'year': 2017}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Saving data for JB33429: {'auction_closing_time': 1774883944.0, 'created_time': 1774522628.154338, 'last_price_update_time': 1774809559.161358}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB33429') HTTP/1.1" 204 0
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Scrape type for CK59033: 2
2026-03-29 18:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-29 18:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7e79539-dad3-54b0-bbb2-a0517f5a3682 with scrape type 2
2026-03-29 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7e79539-dad3-54b0-bbb2-a0517f5a3682 with scrape type 2
2026-03-29 18:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7e79539-dad3-54b0-bbb2-a0517f5a3682, identifier: CK59033
2026-03-29 18:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-29 18:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033
2026-03-29 18:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7e79539-dad3-54b0-bbb2-a0517f5a3682 with identifier: CK59033 to the API
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:37:39Z',
'fuel_type': 'diesel',
'id': 'e7e79539-dad3-54b0-bbb2-a0517f5a3682',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK59033',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 114303,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-16',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2018}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Saving data for CK59033: {'auction_closing_time': 1774885059.0, 'created_time': 1773426942.174199, 'last_price_update_time': 1774809559.575728}
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK59033') HTTP/1.1" 204 0
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-29 18:39:19 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-29 18:39:19 [auto1.de] INFO: Scrape type for GE96921: 2
2026-03-29 18:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-29 18:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with scrape type 2
2026-03-29 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with scrape type 2
2026-03-29 18:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2, identifier: GE96921
2026-03-29 18:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-29 18:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-29 18:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921 to the API
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:57Z',
'fuel_type': 'petrol',
'id': '7d39dd74-0625-51b9-ac43-4aed8c9fc7e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE96921',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 43651,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-25',
'seller_name': None,
'title': 'Cupra Formentor 1.5 TSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Saving data for GE96921: {'auction_closing_time': 1774885257.0, 'created_time': 1773861194.299167, 'last_price_update_time': 1774809560.035519}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE96921') HTTP/1.1" 204 0
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Scrape type for JW75116: 2
2026-03-29 18:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-29 18:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d94085-8df5-5065-b83a-9b9cf820ab25 with scrape type 2
2026-03-29 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40d94085-8df5-5065-b83a-9b9cf820ab25 with scrape type 2
2026-03-29 18:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40d94085-8df5-5065-b83a-9b9cf820ab25, identifier: JW75116
2026-03-29 18:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-29 18:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-29 18:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116 to the API
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:05:14Z',
'fuel_type': 'petrol',
'id': '40d94085-8df5-5065-b83a-9b9cf820ab25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW75116',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLS-Klasse',
'odometer': 219046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-05',
'seller_name': None,
'title': 'Mercedes-Benz GLS-Klasse GLS 400 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Saving data for JW75116: {'auction_closing_time': 1774883114.0, 'created_time': 1773917488.120116, 'last_price_update_time': 1774809560.501157}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW75116') HTTP/1.1" 204 0
2026-03-29 18:39:20 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-29 18:39:20 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Scrape type for DM95893: 2
2026-03-29 18:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-29 18:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554b29d2-a347-5b52-86dd-7131753e682d with scrape type 2
2026-03-29 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554b29d2-a347-5b52-86dd-7131753e682d with scrape type 2
2026-03-29 18:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 554b29d2-a347-5b52-86dd-7131753e682d, identifier: DM95893
2026-03-29 18:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-29 18:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-29 18:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893 to the API
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:15:28Z',
'fuel_type': 'diesel',
'id': '554b29d2-a347-5b52-86dd-7131753e682d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM95893',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 186747,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-18',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2018}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-29 18:39:20 [auto1.de] INFO: Saving data for DM95893: {'auction_closing_time': 1774883728.0, 'created_time': 1773858966.321153, 'last_price_update_time': 1774809560.965538}
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM95893') HTTP/1.1" 204 0
2026-03-29 18:39:21 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Scrape type for GE16553: 2
2026-03-29 18:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-29 18:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with scrape type 2
2026-03-29 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with scrape type 2
2026-03-29 18:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d, identifier: GE16553
2026-03-29 18:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:21 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN96808%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Scrape type for UN96808: 0
2026-03-29 18:39:21 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Scrape type for DW78199: 2
2026-03-29 18:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-29 18:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with scrape type 2
2026-03-29 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with scrape type 2
2026-03-29 18:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082, identifier: DW78199
2026-03-29 18:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-29 18:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-29 18:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553 to the API
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:56:30Z',
'fuel_type': 'diesel',
'id': 'dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE16553',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 103087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-17',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 310 L1 Sport',
'transmission': 'automatic',
'trim': '310 L1 Sport',
'year': 2019}
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-29 18:39:21 [auto1.de] INFO: Saving data for GE16553: {'auction_closing_time': 1774886190.0, 'created_time': 1774608022.077746, 'last_price_update_time': 1774809561.645134}
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE16553') HTTP/1.1" 204 0
2026-03-29 18:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-29 18:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-29 18:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199 to the API
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:48:56Z',
'fuel_type': 'petrol',
'id': '56e1608e-d7cf-5a1a-9f42-3a8d91e81082',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW78199',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 46733,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-29 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Saving data for DW78199: {'auction_closing_time': 1774885736.0, 'created_time': 1773304343.368967, 'last_price_update_time': 1774809562.008449}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW78199') HTTP/1.1" 204 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE41778%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for DE41778: 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for GB33155: 2
2026-03-29 18:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-29 18:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4513884a-a292-5c24-86ce-a6b7efa1127a with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4513884a-a292-5c24-86ce-a6b7efa1127a with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4513884a-a292-5c24-86ce-a6b7efa1127a, identifier: GB33155
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-29 18:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-29 18:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-29 18:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155 to the API
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:44:01Z',
'fuel_type': 'diesel',
'id': '4513884a-a292-5c24-86ce-a6b7efa1127a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB33155',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 141542,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-08',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2016}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Saving data for GB33155: {'auction_closing_time': 1774885441.0, 'created_time': 1774607768.059367, 'last_price_update_time': 1774809562.489495}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB33155') HTTP/1.1" 204 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for AU85949: 0
2026-03-29 18:39:22 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Scrape type for SP97012: 2
2026-03-29 18:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012
2026-03-29 18:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a37772f-de89-5640-b593-3f7dd9722c1f with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a37772f-de89-5640-b593-3f7dd9722c1f with scrape type 2
2026-03-29 18:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a37772f-de89-5640-b593-3f7dd9722c1f, identifier: SP97012
2026-03-29 18:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012
2026-03-29 18:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012
2026-03-29 18:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a37772f-de89-5640-b593-3f7dd9722c1f with identifier: SP97012 to the API
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:50:46Z',
'fuel_type': 'petrol',
'id': '1a37772f-de89-5640-b593-3f7dd9722c1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP97012',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 110572,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-06',
'seller_name': None,
'title': 'Hyundai i20 1.2 Passion',
'transmission': 'manual',
'trim': 'Passion',
'year': 2016}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-29 18:39:22 [auto1.de] INFO: Saving data for SP97012: {'auction_closing_time': 1774885846.0, 'created_time': 1774550132.308179, 'last_price_update_time': 1774809562.938139}
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP97012') HTTP/1.1" 204 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for MA42451: 2
2026-03-29 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451
2026-03-29 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef96b239-8aea-5bf6-81c9-ac6ca2d07872, identifier: MA42451
2026-03-29 18:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451
2026-03-29 18:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451
2026-03-29 18:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef96b239-8aea-5bf6-81c9-ac6ca2d07872 with identifier: MA42451 to the API
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:55:17Z',
'fuel_type': 'diesel',
'id': 'ef96b239-8aea-5bf6-81c9-ac6ca2d07872',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA42451',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 106368,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-11',
'seller_name': None,
'title': 'Opel Vivaro 2.0 CDTI Kombi L1H1 2,7t',
'transmission': 'manual',
'trim': 'Kombi L1H1 2,7t',
'year': 2013}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Saving data for MA42451: {'auction_closing_time': 1774886117.0, 'created_time': 1773831260.018224, 'last_price_update_time': 1774809563.464887}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA42451') HTTP/1.1" 204 0
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-29 18:39:23 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Scrape type for EL90308: 2
2026-03-29 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-29 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f652e903-b139-5056-98e1-d42b447e55eb with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f652e903-b139-5056-98e1-d42b447e55eb with scrape type 2
2026-03-29 18:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f652e903-b139-5056-98e1-d42b447e55eb, identifier: EL90308
2026-03-29 18:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-29 18:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-29 18:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308 to the API
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:47:22Z',
'fuel_type': 'diesel',
'id': 'f652e903-b139-5056-98e1-d42b447e55eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL90308',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 152943,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-25',
'seller_name': None,
'title': 'Opel Meriva 1.3 CDTI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-29 18:39:23 [auto1.de] INFO: Saving data for EL90308: {'auction_closing_time': 1774885642.0, 'created_time': 1773136515.237769, 'last_price_update_time': 1774809563.983159}
2026-03-29 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL90308') HTTP/1.1" 204 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for ZR08367: 2
2026-03-29 18:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-29 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d98715-d5bd-5045-b106-666888f5010e with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d98715-d5bd-5045-b106-666888f5010e with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d98715-d5bd-5045-b106-666888f5010e, identifier: ZR08367
2026-03-29 18:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-29 18:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367
2026-03-29 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d98715-d5bd-5045-b106-666888f5010e with identifier: ZR08367 to the API
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:57:41Z',
'fuel_type': 'petrol',
'id': '25d98715-d5bd-5045-b106-666888f5010e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR08367',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 107814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-31',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Saving data for ZR08367: {'auction_closing_time': 1774886261.0, 'created_time': 1774521562.999123, 'last_price_update_time': 1774809564.444534}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR08367') HTTP/1.1" 204 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR96643%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for MR96643: 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for KV57112: 2
2026-03-29 18:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112
2026-03-29 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 346156e2-f9e2-5727-93ca-a77304334280 with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 346156e2-f9e2-5727-93ca-a77304334280 with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 346156e2-f9e2-5727-93ca-a77304334280, identifier: KV57112
2026-03-29 18:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112
2026-03-29 18:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112
2026-03-29 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 346156e2-f9e2-5727-93ca-a77304334280 with identifier: KV57112 to the API
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:36:12Z',
'fuel_type': 'diesel',
'id': '346156e2-f9e2-5727-93ca-a77304334280',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV57112',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 131139,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-06',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 250 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2017}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Saving data for KV57112: {'auction_closing_time': 1774884972.0, 'created_time': 1774034648.295742, 'last_price_update_time': 1774809564.879265}
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV57112') HTTP/1.1" 204 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH56246%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for CH56246: 0
2026-03-29 18:39:24 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-29 18:39:24 [auto1.de] INFO: Scrape type for GC04938: 2
2026-03-29 18:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-29 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d782adae-621d-5fef-a03f-a677a8b4cb84 with scrape type 2
2026-03-29 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d782adae-621d-5fef-a03f-a677a8b4cb84 with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d782adae-621d-5fef-a03f-a677a8b4cb84, identifier: GC04938
2026-03-29 18:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-29 18:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-29 18:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938 to the API
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:22:12Z',
'fuel_type': 'hybrid',
'id': 'd782adae-621d-5fef-a03f-a677a8b4cb84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC04938',
'listing': 'auction',
'make': 'Opel',
'model': 'Grandland X',
'odometer': 45127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-26',
'seller_name': None,
'title': 'Opel Grandland X 1.6 Plug-in Hybrid Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2021}
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-29 18:39:25 [auto1.de] INFO: Saving data for GC04938: {'auction_closing_time': 1774884132.0, 'created_time': 1774608324.393389, 'last_price_update_time': 1774809565.449062}
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC04938') HTTP/1.1" 204 0
2026-03-29 18:39:25 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-29 18:39:25 [auto1.de] INFO: Scrape type for VK31305: 2
2026-03-29 18:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-29 18:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with scrape type 2
2026-03-29 18:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c, identifier: VK31305
2026-03-29 18:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-29 18:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-29 18:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305 to the API
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:53:04Z',
'fuel_type': 'diesel',
'id': '1201c46e-9f17-5bdc-88aa-a87f1c48e62c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK31305',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 48707,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-23',
'seller_name': None,
'title': 'BMW 1er 120d xDrive Sport Line',
'transmission': 'automatic',
'trim': 'xDrive Sport Line',
'year': 2023}
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-29 18:39:25 [auto1.de] INFO: Saving data for VK31305: {'auction_closing_time': 1774885984.0, 'created_time': 1773646543.711592, 'last_price_update_time': 1774809565.993074}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK31305') HTTP/1.1" 204 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71458%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for WJ71458: 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX77194%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for SX77194: 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for XZ35475: 2
2026-03-29 18:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-29 18:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03ad88f-08f3-552b-a128-229003eeefb7 with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03ad88f-08f3-552b-a128-229003eeefb7 with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03ad88f-08f3-552b-a128-229003eeefb7, identifier: XZ35475
2026-03-29 18:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-29 18:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-29 18:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475 to the API
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:21:31Z',
'fuel_type': 'diesel',
'id': 'b03ad88f-08f3-552b-a128-229003eeefb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ35475',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 279155,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-10',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2006}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Saving data for XZ35475: {'auction_closing_time': 1774884091.0, 'created_time': 1773858921.766989, 'last_price_update_time': 1774809566.499506}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ35475') HTTP/1.1" 204 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for XU52502: 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for UH40808: 2
2026-03-29 18:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-29 18:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c, identifier: UH40808
2026-03-29 18:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-29 18:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-29 18:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808 to the API
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:00:22Z',
'fuel_type': 'hybrid',
'id': '9bc8adaf-a9e8-510e-a96f-641f78a0a15c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH40808',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 27201,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-18',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Saving data for UH40808: {'auction_closing_time': 1774882822.0, 'created_time': 1774607967.863991, 'last_price_update_time': 1774809566.958595}
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH40808') HTTP/1.1" 204 0
2026-03-29 18:39:26 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-29 18:39:26 [auto1.de] INFO: Scrape type for CS76015: 2
2026-03-29 18:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015
2026-03-29 18:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d3b1f0-1250-51d7-9894-06060af54cae with scrape type 2
2026-03-29 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d3b1f0-1250-51d7-9894-06060af54cae with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d3b1f0-1250-51d7-9894-06060af54cae, identifier: CS76015
2026-03-29 18:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015
2026-03-29 18:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015
2026-03-29 18:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d3b1f0-1250-51d7-9894-06060af54cae with identifier: CS76015 to the API
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:38:26Z',
'fuel_type': 'petrol',
'id': 'a4d3b1f0-1250-51d7-9894-06060af54cae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS76015',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 55477,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-11',
'seller_name': None,
'title': 'Opel Corsa 1.4 Drive',
'transmission': 'manual',
'trim': 'Drive',
'year': 2016}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Saving data for CS76015: {'auction_closing_time': 1774885106.0, 'created_time': 1774636642.030374, 'last_price_update_time': 1774809567.350535}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS76015') HTTP/1.1" 204 0
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Scrape type for YJ51408: 2
2026-03-29 18:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-29 18:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0, identifier: YJ51408
2026-03-29 18:39:27 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-29 18:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-29 18:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408 to the API
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:32:52Z',
'fuel_type': 'diesel',
'id': '99e4a30f-26f4-5199-8aea-c26cfbeb21f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ51408',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 196247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-19',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2014}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Saving data for YJ51408: {'auction_closing_time': 1774884772.0, 'created_time': 1774293333.078668, 'last_price_update_time': 1774809567.885037}
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ51408') HTTP/1.1" 204 0
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-29 18:39:27 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-29 18:39:27 [auto1.de] INFO: Scrape type for EX27277: 2
2026-03-29 18:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-29 18:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53456ef-07da-57e0-8532-8606bba5fcf4 with scrape type 2
2026-03-29 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a53456ef-07da-57e0-8532-8606bba5fcf4 with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53456ef-07da-57e0-8532-8606bba5fcf4, identifier: EX27277
2026-03-29 18:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-29 18:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277
2026-03-29 18:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53456ef-07da-57e0-8532-8606bba5fcf4 with identifier: EX27277 to the API
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:39:15Z',
'fuel_type': 'petrol',
'id': 'a53456ef-07da-57e0-8532-8606bba5fcf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX27277',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 190703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-12-22',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 Kombi',
'transmission': 'manual',
'trim': 'Kombi',
'year': 2004}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Saving data for EX27277: {'auction_closing_time': 1774885155.0, 'created_time': 1773387366.282428, 'last_price_update_time': 1774809568.315963}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX27277') HTTP/1.1" 204 0
2026-03-29 18:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for UA25868: 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ60723%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for MZ60723: 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX50427%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for VX50427: 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for GB19657: 2
2026-03-29 18:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-29 18:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6eb3ecf-0385-5581-9ea6-c3c495d3066b with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6eb3ecf-0385-5581-9ea6-c3c495d3066b with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6eb3ecf-0385-5581-9ea6-c3c495d3066b, identifier: GB19657
2026-03-29 18:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-29 18:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657
2026-03-29 18:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6eb3ecf-0385-5581-9ea6-c3c495d3066b with identifier: GB19657 to the API
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:28:38Z',
'fuel_type': 'petrol',
'id': 'a6eb3ecf-0385-5581-9ea6-c3c495d3066b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB19657',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 118632,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-24',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Saving data for GB19657: {'auction_closing_time': 1774884518.0, 'created_time': 1773402151.748617, 'last_price_update_time': 1774809568.858213}
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB19657') HTTP/1.1" 204 0
2026-03-29 18:39:28 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ39643%27 HTTP/1.1" 200 None
2026-03-29 18:39:28 [auto1.de] INFO: Scrape type for JJ39643: 2
2026-03-29 18:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643
2026-03-29 18:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e7034be-46ca-5daf-9cf3-3e71776ec507 with scrape type 2
2026-03-29 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e7034be-46ca-5daf-9cf3-3e71776ec507 with scrape type 2
2026-03-29 18:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e7034be-46ca-5daf-9cf3-3e71776ec507, identifier: JJ39643
2026-03-29 18:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643
2026-03-29 18:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643
2026-03-29 18:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e7034be-46ca-5daf-9cf3-3e71776ec507 with identifier: JJ39643 to the API
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:44:43Z',
'fuel_type': 'diesel',
'id': '0e7034be-46ca-5daf-9cf3-3e71776ec507',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ39643',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'R-Klasse',
'odometer': 355203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-11',
'seller_name': None,
'title': 'Mercedes-Benz R-Klasse R 300 CDI BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2012}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ39643%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Saving data for JJ39643: {'auction_closing_time': 1774885483.0, 'created_time': 1774002450.925007, 'last_price_update_time': 1774809569.291445}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ39643') HTTP/1.1" 204 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB12349%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Scrape type for WB12349: 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Scrape type for KL38868: 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Scrape type for BJ31953: 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Scrape type for DF93652: 2
2026-03-29 18:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-29 18:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with scrape type 2
2026-03-29 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with scrape type 2
2026-03-29 18:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab, identifier: DF93652
2026-03-29 18:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-29 18:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-29 18:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652 to the API
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:36:28Z',
'fuel_type': 'petrol',
'id': '45e1a13a-53bc-5f5c-8dce-3fa9de323dab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF93652',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 174284,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-13',
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Saving data for DF93652: {'auction_closing_time': 1774884988.0, 'created_time': 1774293735.382538, 'last_price_update_time': 1774809569.858432}
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF93652') HTTP/1.1" 204 0
2026-03-29 18:39:29 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-29 18:39:29 [auto1.de] INFO: Scrape type for DB09023: 2
2026-03-29 18:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-29 18:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57346407-60b7-5b98-a189-9b9f67b88ff2 with scrape type 2
2026-03-29 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57346407-60b7-5b98-a189-9b9f67b88ff2 with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57346407-60b7-5b98-a189-9b9f67b88ff2, identifier: DB09023
2026-03-29 18:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-29 18:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-29 18:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023 to the API
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:15:42Z',
'fuel_type': 'petrol',
'id': '57346407-60b7-5b98-a189-9b9f67b88ff2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB09023',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 128234,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-09',
'seller_name': None,
'title': 'Ford Ka 1.2 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Saving data for DB09023: {'auction_closing_time': 1774883742.0, 'created_time': 1774608600.462799, 'last_price_update_time': 1774809570.417239}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB09023') HTTP/1.1" 204 0
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC81606%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Scrape type for EC81606: 2
2026-03-29 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606
2026-03-29 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d48810-3049-56cc-b4bc-256b36f7b081 with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63d48810-3049-56cc-b4bc-256b36f7b081 with scrape type 2
2026-03-29 18:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63d48810-3049-56cc-b4bc-256b36f7b081, identifier: EC81606
2026-03-29 18:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606
2026-03-29 18:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606
2026-03-29 18:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63d48810-3049-56cc-b4bc-256b36f7b081 with identifier: EC81606 to the API
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:15:05Z',
'fuel_type': 'petrol',
'id': '63d48810-3049-56cc-b4bc-256b36f7b081',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC81606',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 178925,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-06',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.2 TSI Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC81606%27 HTTP/1.1" 200 None
2026-03-29 18:39:30 [auto1.de] INFO: Saving data for EC81606: {'auction_closing_time': 1774883705.0, 'created_time': 1774089533.795378, 'last_price_update_time': 1774809570.834687}
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC81606') HTTP/1.1" 204 0
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-29 18:39:30 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-29 18:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:31 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL76772%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for TL76772: 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for ZN73895: 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for WA89012: 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for VA54301: 2
2026-03-29 18:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301
2026-03-29 18:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c19188-3369-53d3-bfc0-078b879d1b1f with scrape type 2
2026-03-29 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c19188-3369-53d3-bfc0-078b879d1b1f with scrape type 2
2026-03-29 18:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53c19188-3369-53d3-bfc0-078b879d1b1f, identifier: VA54301
2026-03-29 18:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301
2026-03-29 18:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301
2026-03-29 18:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53c19188-3369-53d3-bfc0-078b879d1b1f with identifier: VA54301 to the API
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:08:08Z',
'fuel_type': 'petrol',
'id': '53c19188-3369-53d3-bfc0-078b879d1b1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA54301',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 54101,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-10',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2018}
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Saving data for VA54301: {'auction_closing_time': 1774883288.0, 'created_time': 1772544081.676093, 'last_price_update_time': 1774809571.852101}
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA54301') HTTP/1.1" 204 0
2026-03-29 18:39:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:31 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-29 18:39:31 [auto1.de] INFO: Scrape type for HY47852: 2
2026-03-29 18:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-29 18:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with scrape type 2
2026-03-29 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665, identifier: HY47852
2026-03-29 18:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-29 18:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-29 18:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852 to the API
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:59:28Z',
'fuel_type': 'diesel',
'id': '6ac0ffb0-805d-5c0a-b3f7-98d42792c665',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY47852',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 193655,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-20',
'seller_name': None,
'title': 'BMW X1 xDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Saving data for HY47852: {'auction_closing_time': 1774886368.0, 'created_time': 1773134432.947238, 'last_price_update_time': 1774809572.393525}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY47852') HTTP/1.1" 204 0
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Scrape type for SM09271: 0
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Scrape type for DX42832: 0
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Scrape type for SY34106: 2
2026-03-29 18:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-29 18:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e, identifier: SY34106
2026-03-29 18:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-29 18:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-29 18:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106 to the API
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:34:05Z',
'fuel_type': 'diesel',
'id': '8ab9479e-42f4-5d2d-8a4e-8256e191a47e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY34106',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 123575,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-10',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2017}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Saving data for SY34106: {'auction_closing_time': 1774884845.0, 'created_time': 1773305456.105949, 'last_price_update_time': 1774809572.942262}
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY34106') HTTP/1.1" 204 0
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-29 18:39:32 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-29 18:39:32 [auto1.de] INFO: Scrape type for MF56816: 2
2026-03-29 18:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-29 18:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d0ebea-faf1-51a4-bbb9-707001d8db27 with scrape type 2
2026-03-29 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8d0ebea-faf1-51a4-bbb9-707001d8db27 with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8d0ebea-faf1-51a4-bbb9-707001d8db27, identifier: MF56816
2026-03-29 18:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-29 18:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816
2026-03-29 18:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8d0ebea-faf1-51a4-bbb9-707001d8db27 with identifier: MF56816 to the API
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:47:15Z',
'fuel_type': 'diesel',
'id': 'e8d0ebea-faf1-51a4-bbb9-707001d8db27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF56816',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 165894,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-28',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Saving data for MF56816: {'auction_closing_time': 1774885635.0, 'created_time': 1774522036.277938, 'last_price_update_time': 1774809573.365845}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF56816') HTTP/1.1" 204 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for CK72953: 2
2026-03-29 18:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-29 18:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f297e0e-9dbb-5272-a8f5-138589e5994b with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f297e0e-9dbb-5272-a8f5-138589e5994b with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f297e0e-9dbb-5272-a8f5-138589e5994b, identifier: CK72953
2026-03-29 18:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-29 18:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-29 18:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953 to the API
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:39:53Z',
'fuel_type': 'petrol',
'id': '2f297e0e-9dbb-5272-a8f5-138589e5994b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK72953',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 132539,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-28',
'seller_name': None,
'title': 'Audi TT 2.0 TFSI Roadster',
'transmission': 'automatic',
'trim': 'Roadster',
'year': 2008}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Saving data for CK72953: {'auction_closing_time': 1774885193.0, 'created_time': 1774608259.768948, 'last_price_update_time': 1774809573.912936}
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK72953') HTTP/1.1" 204 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for PY46067: 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY23917%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for GY23917: 0
2026-03-29 18:39:33 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-29 18:39:33 [auto1.de] INFO: Scrape type for WB03477: 2
2026-03-29 18:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-29 18:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf68544-325e-5a0c-87b8-84dbd2136216 with scrape type 2
2026-03-29 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf68544-325e-5a0c-87b8-84dbd2136216 with scrape type 2
2026-03-29 18:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: daf68544-325e-5a0c-87b8-84dbd2136216, identifier: WB03477
2026-03-29 18:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-29 18:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-29 18:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477 to the API
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:34:19Z',
'fuel_type': 'petrol',
'id': 'daf68544-325e-5a0c-87b8-84dbd2136216',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB03477',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 140843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-07',
'seller_name': None,
'title': 'Hyundai i20 1.4 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2011}
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Saving data for WB03477: {'auction_closing_time': 1774884859.0, 'created_time': 1774294751.774, 'last_price_update_time': 1774809574.421445}
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB03477') HTTP/1.1" 204 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM55237%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for YM55237: 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for NL36228: 2
2026-03-29 18:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-29 18:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with scrape type 2
2026-03-29 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with scrape type 2
2026-03-29 18:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6, identifier: NL36228
2026-03-29 18:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-29 18:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228
2026-03-29 18:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4caa522a-fecf-53c2-876e-e1d9cd2c25b6 with identifier: NL36228 to the API
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:50:06Z',
'fuel_type': 'petrol',
'id': '4caa522a-fecf-53c2-876e-e1d9cd2c25b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL36228',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 86197,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-06',
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Saving data for NL36228: {'auction_closing_time': 1774885806.0, 'created_time': 1773429458.45857, 'last_price_update_time': 1774809574.868575}
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL36228') HTTP/1.1" 204 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-29 18:39:34 [auto1.de] INFO: Scrape type for SG58590: 0
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-29 18:39:34 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-29 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Scrape type for SM09769: 2
2026-03-29 18:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-29 18:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with scrape type 2
2026-03-29 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with scrape type 2
2026-03-29 18:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53, identifier: SM09769
2026-03-29 18:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-29 18:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-29 18:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769 to the API
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:17:21Z',
'fuel_type': 'petrol',
'id': '89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM09769',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 86870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-08',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Saving data for SM09769: {'auction_closing_time': 1774883841.0, 'created_time': 1774607842.094719, 'last_price_update_time': 1774809575.424004}
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM09769') HTTP/1.1" 204 0
2026-03-29 18:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:35 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-29 18:39:35 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Scrape type for SA11985: 2
2026-03-29 18:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-29 18:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e5519d6-1eef-5901-b84b-152399c15e72 with scrape type 2
2026-03-29 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e5519d6-1eef-5901-b84b-152399c15e72 with scrape type 2
2026-03-29 18:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e5519d6-1eef-5901-b84b-152399c15e72, identifier: SA11985
2026-03-29 18:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-29 18:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-29 18:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985 to the API
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:14:18Z',
'fuel_type': 'petrol',
'id': '1e5519d6-1eef-5901-b84b-152399c15e72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA11985',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 159416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-14',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.0 TSI Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2017}
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Saving data for SA11985: {'auction_closing_time': 1774883658.0, 'created_time': 1773306558.875126, 'last_price_update_time': 1774809575.92495}
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA11985') HTTP/1.1" 204 0
2026-03-29 18:39:35 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-29 18:39:35 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-29 18:39:35 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-29 18:39:35 [auto1.de] INFO: Scrape type for NU23717: 2
2026-03-29 18:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-29 18:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with scrape type 2
2026-03-29 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with scrape type 2
2026-03-29 18:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6, identifier: NU23717
2026-03-29 18:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-29 18:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-29 18:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717 to the API
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:57:31Z',
'fuel_type': 'diesel',
'id': 'd66bebd9-b7da-5ea7-a09b-5597a0b9a6e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU23717',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 215538,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-21',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-29 18:39:36 [auto1.de] INFO: Saving data for NU23717: {'auction_closing_time': 1774886251.0, 'created_time': 1774607766.965094, 'last_price_update_time': 1774809576.395828}
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU23717') HTTP/1.1" 204 0
2026-03-29 18:39:36 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-29 18:39:36 [auto1.de] INFO: Scrape type for ML64265: 0
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-29 18:39:36 [auto1.de] INFO: Scrape type for HB95489: 2
2026-03-29 18:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-29 18:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e620f3e6-49a7-5678-840b-c8020f1d696c with scrape type 2
2026-03-29 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e620f3e6-49a7-5678-840b-c8020f1d696c with scrape type 2
2026-03-29 18:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e620f3e6-49a7-5678-840b-c8020f1d696c, identifier: HB95489
2026-03-29 18:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-29 18:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-29 18:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489 to the API
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:38:08Z',
'fuel_type': 'petrol',
'id': 'e620f3e6-49a7-5678-840b-c8020f1d696c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB95489',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 19702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-03-13',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2025}
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-29 18:39:36 [auto1.de] INFO: Saving data for HB95489: {'auction_closing_time': 1774885088.0, 'created_time': 1774608350.293553, 'last_price_update_time': 1774809576.844364}
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB95489') HTTP/1.1" 204 0
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-29 18:39:36 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-29 18:39:36 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-29 18:39:36 [auto1.de] INFO: Scrape type for ZU18943: 2
2026-03-29 18:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-29 18:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bc4754-36b5-5669-815e-2f90396e29c3 with scrape type 2
2026-03-29 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36bc4754-36b5-5669-815e-2f90396e29c3 with scrape type 2
2026-03-29 18:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36bc4754-36b5-5669-815e-2f90396e29c3, identifier: ZU18943
2026-03-29 18:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-29 18:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-29 18:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943 to the API
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:44:35Z',
'fuel_type': 'petrol',
'id': '36bc4754-36b5-5669-815e-2f90396e29c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU18943',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 28590,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-04',
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-29 18:39:37 [auto1.de] INFO: Saving data for ZU18943: {'auction_closing_time': 1774885475.0, 'created_time': 1774607992.887277, 'last_price_update_time': 1774809577.384289}
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU18943') HTTP/1.1" 204 0
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-29 18:39:37 [auto1.de] INFO: Scrape type for JJ68009: 2
2026-03-29 18:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009
2026-03-29 18:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with scrape type 2
2026-03-29 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with scrape type 2
2026-03-29 18:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d, identifier: JJ68009
2026-03-29 18:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009
2026-03-29 18:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009
2026-03-29 18:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a1bf5b5-17f5-57f4-a24a-ee55931ec27d with identifier: JJ68009 to the API
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:45:55Z',
'fuel_type': 'diesel',
'id': '5a1bf5b5-17f5-57f4-a24a-ee55931ec27d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ68009',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Caravelle',
'odometer': 191246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-30',
'seller_name': None,
'title': 'Volkswagen T5 Caravelle 2.0 TDI omfortline 4Motion',
'transmission': 'manual',
'trim': 'omfortline 4Motion',
'year': 2014}
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-29 18:39:37 [auto1.de] INFO: Saving data for JJ68009: {'auction_closing_time': 1774885555.0, 'created_time': 1774636638.488969, 'last_price_update_time': 1774809577.782795}
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ68009') HTTP/1.1" 204 0
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-29 18:39:37 [auto1.de] INFO: Scrape type for CR61198: 0
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-29 18:39:37 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-29 18:39:37 [auto1.de] INFO: Scrape type for ZP61360: 2
2026-03-29 18:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-29 18:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with scrape type 2
2026-03-29 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with scrape type 2
2026-03-29 18:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5429fbce-c6cf-594a-849c-75a0c5adb0b7, identifier: ZP61360
2026-03-29 18:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-29 18:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-29 18:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360 to the API
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:24:47Z',
'fuel_type': 'petrol',
'id': '5429fbce-c6cf-594a-849c-75a0c5adb0b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP61360',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 142946,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-31',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Cool Edition',
'transmission': 'manual',
'trim': 'Cool Edition',
'year': 2009}
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Saving data for ZP61360: {'auction_closing_time': 1774884287.0, 'created_time': 1774251393.89176, 'last_price_update_time': 1774809578.264002}
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP61360') HTTP/1.1" 204 0
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Scrape type for TV47355: 2
2026-03-29 18:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-29 18:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with scrape type 2
2026-03-29 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with scrape type 2
2026-03-29 18:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5, identifier: TV47355
2026-03-29 18:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-29 18:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-29 18:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355 to the API
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:35:43Z',
'fuel_type': 'petrol',
'id': '6c3cdf52-59c3-5208-b551-6bc3db9ad5d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV47355',
'listing': 'auction',
'make': 'Subaru',
'model': 'BRZ',
'odometer': 17574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-14',
'seller_name': None,
'title': 'Subaru BRZ 2.0 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2018}
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Saving data for TV47355: {'auction_closing_time': 1774884943.0, 'created_time': 1773307327.403504, 'last_price_update_time': 1774809578.826577}
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV47355') HTTP/1.1" 204 0
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Scrape type for UZ04747: 0
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Scrape type for PB41592: 0
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Scrape type for EH96711: 0
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Scrape type for XL56937: 0
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-29 18:39:38 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-29 18:39:38 [auto1.de] INFO: Scrape type for BN55276: 2
2026-03-29 18:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-29 18:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93bf116-19cf-5fff-abcc-d3c64aece2a6 with scrape type 2
2026-03-29 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c93bf116-19cf-5fff-abcc-d3c64aece2a6 with scrape type 2
2026-03-29 18:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c93bf116-19cf-5fff-abcc-d3c64aece2a6, identifier: BN55276
2026-03-29 18:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-29 18:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-29 18:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276 to the API
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 151,
'expiration_date': '2026-03-30T15:18:36Z',
'fuel_type': 'petrol',
'id': 'c93bf116-19cf-5fff-abcc-d3c64aece2a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN55276',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 46113,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-23',
'seller_name': None,
'title': 'Fiat 500X 1.3 Turbo Cross',
'transmission': 'automatic',
'trim': 'Cross',
'year': 2021}
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-29 18:39:39 [auto1.de] INFO: Saving data for BN55276: {'auction_closing_time': 1774883916.0, 'created_time': 1773400902.368161, 'last_price_update_time': 1774809579.346053}
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN55276') HTTP/1.1" 204 0
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-29 18:39:39 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-29 18:39:39 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-29 18:39:39 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-29 18:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:40 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:40 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-29 18:39:40 [auto1.de] INFO: Scrape type for NF88064: 2
2026-03-29 18:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-29 18:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92de2b6d-5010-5db3-ad16-9b4571e94f00 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92de2b6d-5010-5db3-ad16-9b4571e94f00 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92de2b6d-5010-5db3-ad16-9b4571e94f00, identifier: NF88064
2026-03-29 18:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-29 18:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064
2026-03-29 18:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92de2b6d-5010-5db3-ad16-9b4571e94f00 with identifier: NF88064 to the API
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:58:11Z',
'fuel_type': 'petrol',
'id': '92de2b6d-5010-5db3-ad16-9b4571e94f00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF88064',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 142808,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-08',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TSI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2018}
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-29 18:39:40 [auto1.de] INFO: Saving data for NF88064: {'auction_closing_time': 1774886291.0, 'created_time': 1773381630.819834, 'last_price_update_time': 1774809580.666635}
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF88064') HTTP/1.1" 204 0
2026-03-29 18:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:40 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-29 18:39:40 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-29 18:39:40 [auto1.de] INFO: Scrape type for AN15165: 2
2026-03-29 18:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-29 18:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c212417-4fab-50a3-a22a-bc2614180ae0 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c212417-4fab-50a3-a22a-bc2614180ae0 with scrape type 2
2026-03-29 18:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c212417-4fab-50a3-a22a-bc2614180ae0, identifier: AN15165
2026-03-29 18:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-29 18:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-29 18:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165 to the API
2026-03-29 18:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:31:26Z',
'fuel_type': 'hybrid',
'id': '3c212417-4fab-50a3-a22a-bc2614180ae0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN15165',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 96025,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-22',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2022}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Saving data for AN15165: {'auction_closing_time': 1774884686.0, 'created_time': 1774608581.029984, 'last_price_update_time': 1774809581.221564}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN15165') HTTP/1.1" 204 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for JV66840: 2
2026-03-29 18:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-29 18:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66e88fe-f417-571c-955a-d46ee92603db with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f66e88fe-f417-571c-955a-d46ee92603db with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f66e88fe-f417-571c-955a-d46ee92603db, identifier: JV66840
2026-03-29 18:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-29 18:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840
2026-03-29 18:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f66e88fe-f417-571c-955a-d46ee92603db with identifier: JV66840 to the API
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:11Z',
'fuel_type': 'diesel',
'id': 'f66e88fe-f417-571c-955a-d46ee92603db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV66840',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 78935,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-05',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
'transmission': 'automatic',
'trim': 'Trendline',
'year': 2019}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Saving data for JV66840: {'auction_closing_time': 1774886231.0, 'created_time': 1774521607.543785, 'last_price_update_time': 1774809581.680765}
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV66840') HTTP/1.1" 204 0
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-29 18:39:41 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-29 18:39:41 [auto1.de] INFO: Scrape type for DG61616: 2
2026-03-29 18:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-29 18:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7859677f-fbf3-55c2-a7eb-bf191be718de with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7859677f-fbf3-55c2-a7eb-bf191be718de with scrape type 2
2026-03-29 18:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7859677f-fbf3-55c2-a7eb-bf191be718de, identifier: DG61616
2026-03-29 18:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-29 18:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-29 18:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616 to the API
2026-03-29 18:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:20Z',
'fuel_type': 'petrol',
'id': '7859677f-fbf3-55c2-a7eb-bf191be718de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG61616',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 46593,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-30',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2020}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Saving data for DG61616: {'auction_closing_time': 1774884260.0, 'created_time': 1773346017.777766, 'last_price_update_time': 1774809582.164583}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG61616') HTTP/1.1" 204 0
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV33295%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Scrape type for PV33295: 2
2026-03-29 18:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295
2026-03-29 18:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d48c85-8ff1-5a97-bb75-d680d5303806 with scrape type 2
2026-03-29 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d48c85-8ff1-5a97-bb75-d680d5303806 with scrape type 2
2026-03-29 18:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d48c85-8ff1-5a97-bb75-d680d5303806, identifier: PV33295
2026-03-29 18:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295
2026-03-29 18:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295
2026-03-29 18:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d48c85-8ff1-5a97-bb75-d680d5303806 with identifier: PV33295 to the API
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:26:30Z',
'fuel_type': 'petrol',
'id': 'f8d48c85-8ff1-5a97-bb75-d680d5303806',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV33295',
'listing': 'auction',
'make': 'BMW',
'model': 'X2',
'odometer': 65970,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'BMW X2 M35i',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV33295%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Saving data for PV33295: {'auction_closing_time': 1774884390.0, 'created_time': 1773340955.190953, 'last_price_update_time': 1774809582.597135}
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV33295') HTTP/1.1" 204 0
2026-03-29 18:39:42 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-29 18:39:42 [auto1.de] INFO: Scrape type for MH20468: 2
2026-03-29 18:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-29 18:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c352e107-2b72-519c-86d3-e21931e56e57 with scrape type 2
2026-03-29 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c352e107-2b72-519c-86d3-e21931e56e57 with scrape type 2
2026-03-29 18:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c352e107-2b72-519c-86d3-e21931e56e57, identifier: MH20468
2026-03-29 18:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-29 18:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468
2026-03-29 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c352e107-2b72-519c-86d3-e21931e56e57 with identifier: MH20468 to the API
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 156,
'expiration_date': '2026-03-30T15:21:00Z',
'fuel_type': 'petrol',
'id': 'c352e107-2b72-519c-86d3-e21931e56e57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH20468',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 51593,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-28',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Saving data for MH20468: {'auction_closing_time': 1774884060.0, 'created_time': 1773946254.387335, 'last_price_update_time': 1774809583.213467}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH20468') HTTP/1.1" 204 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW15579%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for VW15579: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for VE65204: 2
2026-03-29 18:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-29 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae377aab-f6b2-5016-a441-7a4a9e9d7d37, identifier: VE65204
2026-03-29 18:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-29 18:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-29 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204 to the API
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:43:51Z',
'fuel_type': 'diesel',
'id': 'ae377aab-f6b2-5016-a441-7a4a9e9d7d37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE65204',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 134735,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-31',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2018}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Saving data for VE65204: {'auction_closing_time': 1774885431.0, 'created_time': 1774263232.331561, 'last_price_update_time': 1774809583.693846}
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE65204') HTTP/1.1" 204 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63876%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for DZ63876: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45132%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for BH45132: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN58244%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for JN58244: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for ZE28536: 0
2026-03-29 18:39:43 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-29 18:39:43 [auto1.de] INFO: Scrape type for CY45921: 2
2026-03-29 18:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-29 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with scrape type 2
2026-03-29 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with scrape type 2
2026-03-29 18:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5, identifier: CY45921
2026-03-29 18:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-29 18:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921
2026-03-29 18:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5 with identifier: CY45921 to the API
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:50:31Z',
'fuel_type': 'petrol',
'id': 'f1dcb2bf-43d3-58f5-8dfa-214881ba5eb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY45921',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 40343,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-13',
'seller_name': None,
'title': 'Seat Ibiza 1.0 TSI Beats',
'transmission': 'manual',
'trim': 'Beats',
'year': 2020}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Saving data for CY45921: {'auction_closing_time': 1774885831.0, 'created_time': 1774521622.535347, 'last_price_update_time': 1774809584.383377}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY45921') HTTP/1.1" 204 0
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Scrape type for GM93561: 2
2026-03-29 18:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561
2026-03-29 18:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be70f286-8ac9-532f-8791-dd82c6e0ab30 with scrape type 2
2026-03-29 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be70f286-8ac9-532f-8791-dd82c6e0ab30 with scrape type 2
2026-03-29 18:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be70f286-8ac9-532f-8791-dd82c6e0ab30, identifier: GM93561
2026-03-29 18:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561
2026-03-29 18:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561
2026-03-29 18:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be70f286-8ac9-532f-8791-dd82c6e0ab30 with identifier: GM93561 to the API
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:11:53Z',
'fuel_type': 'petrol',
'id': 'be70f286-8ac9-532f-8791-dd82c6e0ab30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM93561',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 141932,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-30',
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2013}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Saving data for GM93561: {'auction_closing_time': 1774883513.0, 'created_time': 1774550174.16482, 'last_price_update_time': 1774809584.794034}
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM93561') HTTP/1.1" 204 0
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-29 18:39:44 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-29 18:39:44 [auto1.de] INFO: Scrape type for SJ09412: 2
2026-03-29 18:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-29 18:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with scrape type 2
2026-03-29 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363, identifier: SJ09412
2026-03-29 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-29 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-29 18:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412 to the API
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:45:27Z',
'fuel_type': 'diesel',
'id': '9b4c5809-2e22-5eb9-94e9-06b3bee7f363',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ09412',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 209333,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-05',
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Saving data for SJ09412: {'auction_closing_time': 1774885527.0, 'created_time': 1774262913.05438, 'last_price_update_time': 1774809585.315621}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ09412') HTTP/1.1" 204 0
2026-03-29 18:39:45 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Scrape type for AR39544: 2
2026-03-29 18:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-29 18:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001cbd09-e9c2-5254-841c-b49df085b02d with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 001cbd09-e9c2-5254-841c-b49df085b02d with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 001cbd09-e9c2-5254-841c-b49df085b02d, identifier: AR39544
2026-03-29 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-29 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-29 18:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544 to the API
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:14:24Z',
'fuel_type': 'petrol',
'id': '001cbd09-e9c2-5254-841c-b49df085b02d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR39544',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 105441,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-13',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
'transmission': 'manual',
'trim': 'Classic blue 2WD',
'year': 2016}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Saving data for AR39544: {'auction_closing_time': 1774883664.0, 'created_time': 1774293623.500901, 'last_price_update_time': 1774809585.795683}
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR39544') HTTP/1.1" 204 0
2026-03-29 18:39:45 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:45 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-29 18:39:45 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-29 18:39:45 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV25975%27 HTTP/1.1" 200 None
2026-03-29 18:39:45 [auto1.de] INFO: Scrape type for SV25975: 2
2026-03-29 18:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975
2026-03-29 18:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with scrape type 2
2026-03-29 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef, identifier: SV25975
2026-03-29 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975
2026-03-29 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975
2026-03-29 18:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36fc3d5d-3448-5e19-a156-1b6259b8c2ef with identifier: SV25975 to the API
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:13Z',
'fuel_type': 'diesel',
'id': '36fc3d5d-3448-5e19-a156-1b6259b8c2ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV25975',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 174913,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-28',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sendo 2WD',
'transmission': 'manual',
'trim': 'Sendo 2WD',
'year': 2015}
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV25975%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Saving data for SV25975: {'auction_closing_time': 1774885573.0, 'created_time': 1773427595.869437, 'last_price_update_time': 1774809586.269212}
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV25975') HTTP/1.1" 204 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for UH90150: 2
2026-03-29 18:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-29 18:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8, identifier: UH90150
2026-03-29 18:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for RW32541: 0
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-29 18:39:46 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Scrape type for SJ84971: 2
2026-03-29 18:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-29 18:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb75be63-9b9f-5b0c-abff-6533d296129b with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb75be63-9b9f-5b0c-abff-6533d296129b with scrape type 2
2026-03-29 18:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb75be63-9b9f-5b0c-abff-6533d296129b, identifier: SJ84971
2026-03-29 18:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-29 18:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-29 18:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150 to the API
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:21:08Z',
'fuel_type': 'diesel',
'id': 'eacf758b-42e1-5391-97c3-6f3dfe5ad8b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH90150',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 208948,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-19',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Match BlueMotion',
'transmission': 'manual',
'trim': 'Match BlueMotion',
'year': 2012}
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-29 18:39:46 [auto1.de] INFO: Saving data for UH90150: {'auction_closing_time': 1774884068.0, 'created_time': 1773382975.748667, 'last_price_update_time': 1774809586.881921}
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH90150') HTTP/1.1" 204 0
2026-03-29 18:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-29 18:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-29 18:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971 to the API
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:47:43Z',
'fuel_type': 'diesel',
'id': 'fb75be63-9b9f-5b0c-abff-6533d296129b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ84971',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 102769,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-10',
'seller_name': None,
'title': 'Opel Mokka 1.6 CDTI DPF Edition ecoFlex',
'transmission': 'manual',
'trim': 'Edition ecoFlex',
'year': 2017}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Saving data for SJ84971: {'auction_closing_time': 1774885663.0, 'created_time': 1773831066.268847, 'last_price_update_time': 1774809587.339287}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ84971') HTTP/1.1" 204 0
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for YH04834: 2
2026-03-29 18:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-29 18:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e89818-238b-5676-ad89-4085c1019d05 with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e89818-238b-5676-ad89-4085c1019d05 with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e89818-238b-5676-ad89-4085c1019d05, identifier: YH04834
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-29 18:39:47 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Scrape type for BN62296: 2
2026-03-29 18:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-29 18:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b63c329-caa3-547b-975b-76f770a4a703 with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b63c329-caa3-547b-975b-76f770a4a703 with scrape type 2
2026-03-29 18:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b63c329-caa3-547b-975b-76f770a4a703, identifier: BN62296
2026-03-29 18:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-29 18:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-29 18:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834 to the API
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:44:01Z',
'fuel_type': 'petrol',
'id': '27e89818-238b-5676-ad89-4085c1019d05',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH04834',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 41555,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-30',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 170 Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2008}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-29 18:39:47 [auto1.de] INFO: Saving data for YH04834: {'auction_closing_time': 1774885441.0, 'created_time': 1774263797.126811, 'last_price_update_time': 1774809587.874904}
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH04834') HTTP/1.1" 204 0
2026-03-29 18:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-29 18:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-29 18:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296 to the API
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:09:32Z',
'fuel_type': 'petrol',
'id': '1b63c329-caa3-547b-975b-76f770a4a703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN62296',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 80783,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-12',
'seller_name': None,
'title': 'MINI Clubman John Cooper Works ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2022}
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Saving data for BN62296: {'auction_closing_time': 1774883372.0, 'created_time': 1774608604.307859, 'last_price_update_time': 1774809588.22819}
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN62296') HTTP/1.1" 204 0
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK32817%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Scrape type for RK32817: 0
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Scrape type for LT13241: 0
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV47802%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Scrape type for VV47802: 0
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Scrape type for YH72749: 2
2026-03-29 18:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-29 18:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38027e4-da34-5c38-ad8b-832c485af082 with scrape type 2
2026-03-29 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38027e4-da34-5c38-ad8b-832c485af082 with scrape type 2
2026-03-29 18:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38027e4-da34-5c38-ad8b-832c485af082, identifier: YH72749
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-29 18:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-29 18:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-29 18:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749 to the API
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:50:55Z',
'fuel_type': 'petrol',
'id': 'a38027e4-da34-5c38-ad8b-832c485af082',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH72749',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 99121,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-21',
'seller_name': None,
'title': 'Volkswagen Beetle 2.0 TSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2012}
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Saving data for YH72749: {'auction_closing_time': 1774885855.0, 'created_time': 1773772543.630966, 'last_price_update_time': 1774809588.742964}
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH72749') HTTP/1.1" 204 0
2026-03-29 18:39:48 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-29 18:39:48 [auto1.de] INFO: Scrape type for UD88757: 2
2026-03-29 18:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-29 18:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958bc99d-032a-5912-b8cb-b363884515d8 with scrape type 2
2026-03-29 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 958bc99d-032a-5912-b8cb-b363884515d8 with scrape type 2
2026-03-29 18:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 958bc99d-032a-5912-b8cb-b363884515d8, identifier: UD88757
2026-03-29 18:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-29 18:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-29 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757 to the API
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:13:26Z',
'fuel_type': 'petrol',
'id': '958bc99d-032a-5912-b8cb-b363884515d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD88757',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 156121,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-29',
'seller_name': None,
'title': 'Hyundai i20 1.2 Passion',
'transmission': 'manual',
'trim': 'Passion',
'year': 2018}
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Saving data for UD88757: {'auction_closing_time': 1774883606.0, 'created_time': 1773774349.746941, 'last_price_update_time': 1774809589.285613}
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD88757') HTTP/1.1" 204 0
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Scrape type for JP43917: 2
2026-03-29 18:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-29 18:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c4e00c-bbba-5ffc-946f-501ca151a72c with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6c4e00c-bbba-5ffc-946f-501ca151a72c with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6c4e00c-bbba-5ffc-946f-501ca151a72c, identifier: JP43917
2026-03-29 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-29 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917
2026-03-29 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6c4e00c-bbba-5ffc-946f-501ca151a72c with identifier: JP43917 to the API
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-30T15:15:10Z',
'fuel_type': 'petrol',
'id': 'd6c4e00c-bbba-5ffc-946f-501ca151a72c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP43917',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 67409,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-24',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
'transmission': 'automatic',
'trim': 'GTI TCR',
'year': 2019}
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Saving data for JP43917: {'auction_closing_time': 1774883710.0, 'created_time': 1774521369.818013, 'last_price_update_time': 1774809589.694366}
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP43917') HTTP/1.1" 204 0
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-29 18:39:49 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-29 18:39:49 [auto1.de] INFO: Scrape type for KE92828: 2
2026-03-29 18:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-29 18:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb6f17-9819-5f37-b37a-257715535bca with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bdb6f17-9819-5f37-b37a-257715535bca with scrape type 2
2026-03-29 18:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bdb6f17-9819-5f37-b37a-257715535bca, identifier: KE92828
2026-03-29 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-29 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-29 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828 to the API
2026-03-29 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:58:31Z',
'fuel_type': 'petrol',
'id': '3bdb6f17-9819-5f37-b37a-257715535bca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE92828',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 81290,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-28',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe Celebration 4x2',
'transmission': 'manual',
'trim': 'Celebration 4x2',
'year': 2015}
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Saving data for KE92828: {'auction_closing_time': 1774886311.0, 'created_time': 1773946615.33707, 'last_price_update_time': 1774809590.146656}
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE92828') HTTP/1.1" 204 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for ST98775: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS96658%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for AS96658: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for AD81240: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT65416%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for KT65416: 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for JY05464: 2
2026-03-29 18:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-29 18:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8054ab-1784-523a-a320-ceb93a6639a2 with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8054ab-1784-523a-a320-ceb93a6639a2 with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8054ab-1784-523a-a320-ceb93a6639a2, identifier: JY05464
2026-03-29 18:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-29 18:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-29 18:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464 to the API
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:12:31Z',
'fuel_type': 'petrol',
'id': '2a8054ab-1784-523a-a320-ceb93a6639a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY05464',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 59633,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-31',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Saving data for JY05464: {'auction_closing_time': 1774883551.0, 'created_time': 1773303380.819313, 'last_price_update_time': 1774809590.666375}
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY05464') HTTP/1.1" 204 0
2026-03-29 18:39:50 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-29 18:39:50 [auto1.de] INFO: Scrape type for DF96715: 2
2026-03-29 18:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-29 18:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with scrape type 2
2026-03-29 18:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8, identifier: DF96715
2026-03-29 18:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-29 18:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-29 18:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715 to the API
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:35:43Z',
'fuel_type': 'petrol',
'id': '7742fa76-9cc1-5d9f-b388-0277a7f4e6e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF96715',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 77424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TSI FR 4Drive',
'transmission': 'automatic',
'trim': 'FR 4Drive',
'year': 2021}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Saving data for DF96715: {'auction_closing_time': 1774884943.0, 'created_time': 1774293551.8757, 'last_price_update_time': 1774809591.245449}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF96715') HTTP/1.1" 204 0
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Scrape type for XC67226: 2
2026-03-29 18:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-29 18:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7448ae-c3ad-57fe-91ed-618f9cd516ce with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac7448ae-c3ad-57fe-91ed-618f9cd516ce with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac7448ae-c3ad-57fe-91ed-618f9cd516ce, identifier: XC67226
2026-03-29 18:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-29 18:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226
2026-03-29 18:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac7448ae-c3ad-57fe-91ed-618f9cd516ce with identifier: XC67226 to the API
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:36:50Z',
'fuel_type': 'petrol',
'id': 'ac7448ae-c3ad-57fe-91ed-618f9cd516ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC67226',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon',
'odometer': 74122,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-11',
'seller_name': None,
'title': 'Volkswagen Arteon 2.0 TSI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2020}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Saving data for XC67226: {'auction_closing_time': 1774885010.0, 'created_time': 1774521747.744556, 'last_price_update_time': 1774809591.661871}
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC67226') HTTP/1.1" 204 0
2026-03-29 18:39:51 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:51 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-29 18:39:51 [auto1.de] INFO: Scrape type for KX24751: 2
2026-03-29 18:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-29 18:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with scrape type 2
2026-03-29 18:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02, identifier: KX24751
2026-03-29 18:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-29 18:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751
2026-03-29 18:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38dd2c2f-cd8c-5649-b67c-3d8d625e6b02 with identifier: KX24751 to the API
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:25:54Z',
'fuel_type': 'petrol',
'id': '38dd2c2f-cd8c-5649-b67c-3d8d625e6b02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX24751',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 95671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-28',
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.8 Turbo Veloce',
'transmission': 'automatic',
'trim': 'Veloce',
'year': 2016}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Saving data for KX24751: {'auction_closing_time': 1774884354.0, 'created_time': 1774521581.237791, 'last_price_update_time': 1774809592.070629}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX24751') HTTP/1.1" 204 0
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05119%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Scrape type for YT05119: 0
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Scrape type for WD16900: 2
2026-03-29 18:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-29 18:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c9a156-4810-50b1-bd13-4614942f55f9 with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c9a156-4810-50b1-bd13-4614942f55f9 with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2c9a156-4810-50b1-bd13-4614942f55f9, identifier: WD16900
2026-03-29 18:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-29 18:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900
2026-03-29 18:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2c9a156-4810-50b1-bd13-4614942f55f9 with identifier: WD16900 to the API
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:02Z',
'fuel_type': 'diesel',
'id': 'b2c9a156-4810-50b1-bd13-4614942f55f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD16900',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 212953,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-17',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Saving data for WD16900: {'auction_closing_time': 1774883102.0, 'created_time': 1774522543.871373, 'last_price_update_time': 1774809592.498108}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD16900') HTTP/1.1" 204 0
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-29 18:39:52 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Scrape type for CZ09118: 2
2026-03-29 18:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-29 18:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b124c392-0426-5da5-a312-448a6fee290b with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b124c392-0426-5da5-a312-448a6fee290b with scrape type 2
2026-03-29 18:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b124c392-0426-5da5-a312-448a6fee290b, identifier: CZ09118
2026-03-29 18:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-29 18:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-29 18:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118 to the API
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:55Z',
'fuel_type': 'diesel',
'id': 'b124c392-0426-5da5-a312-448a6fee290b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ09118',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 124628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-27',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
'transmission': 'manual',
'trim': 'Center-Line 2WD',
'year': 2013}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-29 18:39:52 [auto1.de] INFO: Saving data for CZ09118: {'auction_closing_time': 1774883455.0, 'created_time': 1773380777.39668, 'last_price_update_time': 1774809592.981452}
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ09118') HTTP/1.1" 204 0
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Scrape type for SX85367: 2
2026-03-29 18:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-29 18:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ac1045-435c-5da7-a577-e451a7325fa4 with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ac1045-435c-5da7-a577-e451a7325fa4 with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9ac1045-435c-5da7-a577-e451a7325fa4, identifier: SX85367
2026-03-29 18:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-29 18:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367
2026-03-29 18:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9ac1045-435c-5da7-a577-e451a7325fa4 with identifier: SX85367 to the API
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:12:00Z',
'fuel_type': 'petrol',
'id': 'a9ac1045-435c-5da7-a577-e451a7325fa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX85367',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 78206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-02',
'seller_name': None,
'title': 'Opel Insignia 2.0 SIDI Turbo Business Innovation 4x4',
'transmission': 'automatic',
'trim': 'Business Innovation 4x4',
'year': 2016}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Saving data for SX85367: {'auction_closing_time': 1774883520.0, 'created_time': 1774522214.001102, 'last_price_update_time': 1774809593.500977}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX85367') HTTP/1.1" 204 0
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Scrape type for SL28048: 2
2026-03-29 18:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-29 18:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb42f229-94a6-52e3-89d6-8ba9c7b2164a with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb42f229-94a6-52e3-89d6-8ba9c7b2164a with scrape type 2
2026-03-29 18:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb42f229-94a6-52e3-89d6-8ba9c7b2164a, identifier: SL28048
2026-03-29 18:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-29 18:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-29 18:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048 to the API
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:54:41Z',
'fuel_type': 'petrol',
'id': 'eb42f229-94a6-52e3-89d6-8ba9c7b2164a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL28048',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 122257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-07',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-29 18:39:53 [auto1.de] INFO: Saving data for SL28048: {'auction_closing_time': 1774886081.0, 'created_time': 1773399707.236227, 'last_price_update_time': 1774809593.981052}
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL28048') HTTP/1.1" 204 0
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-29 18:39:53 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA61541%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for MA61541: 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for EW37787: 2
2026-03-29 18:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-29 18:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30840ba6-ab32-5a63-a268-b91665de409f with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30840ba6-ab32-5a63-a268-b91665de409f with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30840ba6-ab32-5a63-a268-b91665de409f, identifier: EW37787
2026-03-29 18:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-29 18:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787
2026-03-29 18:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30840ba6-ab32-5a63-a268-b91665de409f with identifier: EW37787 to the API
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:26:19Z',
'fuel_type': 'petrol',
'id': '30840ba6-ab32-5a63-a268-b91665de409f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW37787',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 101070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-17',
'seller_name': None,
'title': 'Porsche Macan S',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Saving data for EW37787: {'auction_closing_time': 1774884379.0, 'created_time': 1773382930.846707, 'last_price_update_time': 1774809594.42953}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW37787') HTTP/1.1" 204 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU85370%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for FU85370: 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Scrape type for HC91159: 2
2026-03-29 18:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-29 18:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f0cc5f-b557-5022-af94-650154451bd6 with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f0cc5f-b557-5022-af94-650154451bd6 with scrape type 2
2026-03-29 18:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f0cc5f-b557-5022-af94-650154451bd6, identifier: HC91159
2026-03-29 18:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-29 18:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-29 18:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159 to the API
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:13:10Z',
'fuel_type': 'diesel',
'id': '81f0cc5f-b557-5022-af94-650154451bd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC91159',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 136248,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-16',
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-29 18:39:54 [auto1.de] INFO: Saving data for HC91159: {'auction_closing_time': 1774883590.0, 'created_time': 1774294632.616438, 'last_price_update_time': 1774809594.97241}
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC91159') HTTP/1.1" 204 0
2026-03-29 18:39:54 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-29 18:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Scrape type for DZ26190: 2
2026-03-29 18:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-29 18:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83321f98-14a4-5c31-b76f-553e6c401692 with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83321f98-14a4-5c31-b76f-553e6c401692 with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83321f98-14a4-5c31-b76f-553e6c401692, identifier: DZ26190
2026-03-29 18:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-29 18:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-29 18:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190 to the API
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:16:12Z',
'fuel_type': 'petrol',
'id': '83321f98-14a4-5c31-b76f-553e6c401692',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ26190',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 191765,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-12',
'seller_name': None,
'title': 'Skoda Octavia 1.8 TSI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Saving data for DZ26190: {'auction_closing_time': 1774883772.0, 'created_time': 1773859002.527609, 'last_price_update_time': 1774809595.431231}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ26190') HTTP/1.1" 204 0
2026-03-29 18:39:55 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU38066%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Scrape type for XU38066: 0
2026-03-29 18:39:55 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Scrape type for ZU48886: 2
2026-03-29 18:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-29 18:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4133d45-57bd-557c-bb08-5ae85945d7ae with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4133d45-57bd-557c-bb08-5ae85945d7ae with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4133d45-57bd-557c-bb08-5ae85945d7ae, identifier: ZU48886
2026-03-29 18:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-29 18:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-29 18:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886 to the API
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:01:04Z',
'fuel_type': 'petrol',
'id': 'e4133d45-57bd-557c-bb08-5ae85945d7ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU48886',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 182132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-12',
'seller_name': None,
'title': 'BMW 3er 318i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Saving data for ZU48886: {'auction_closing_time': 1774882864.0, 'created_time': 1773688878.788102, 'last_price_update_time': 1774809595.892867}
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU48886') HTTP/1.1" 204 0
2026-03-29 18:39:55 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-29 18:39:55 [auto1.de] INFO: Scrape type for RM51665: 2
2026-03-29 18:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-29 18:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with scrape type 2
2026-03-29 18:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc, identifier: RM51665
2026-03-29 18:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-29 18:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-29 18:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665 to the API
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:41:26Z',
'fuel_type': 'diesel',
'id': 'ce4719aa-1a6b-5615-b1a4-d4cc0df408fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM51665',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 223790,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-25',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi DPF Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Saving data for RM51665: {'auction_closing_time': 1774885286.0, 'created_time': 1774032379.989111, 'last_price_update_time': 1774809596.355745}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM51665') HTTP/1.1" 204 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for PP42616: 2
2026-03-29 18:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-29 18:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2efc9f65-2879-5396-ad22-f22fd4117735 with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2efc9f65-2879-5396-ad22-f22fd4117735 with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2efc9f65-2879-5396-ad22-f22fd4117735, identifier: PP42616
2026-03-29 18:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-29 18:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616
2026-03-29 18:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2efc9f65-2879-5396-ad22-f22fd4117735 with identifier: PP42616 to the API
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:20:43Z',
'fuel_type': 'petrol',
'id': '2efc9f65-2879-5396-ad22-f22fd4117735',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP42616',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 107383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-02',
'seller_name': None,
'title': 'Mazda CX-5 2.5 Sports-Line AWD',
'transmission': 'automatic',
'trim': 'Sports-Line AWD',
'year': 2021}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Saving data for PP42616: {'auction_closing_time': 1774884043.0, 'created_time': 1774521630.126617, 'last_price_update_time': 1774809596.768552}
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP42616') HTTP/1.1" 204 0
2026-03-29 18:39:56 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-29 18:39:56 [auto1.de] INFO: Scrape type for LL15014: 2
2026-03-29 18:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-29 18:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b448859e-8e9a-53a2-954f-5e189449354a with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b448859e-8e9a-53a2-954f-5e189449354a with scrape type 2
2026-03-29 18:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b448859e-8e9a-53a2-954f-5e189449354a, identifier: LL15014
2026-03-29 18:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-29 18:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-29 18:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014 to the API
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:14:42Z',
'fuel_type': 'petrol',
'id': 'b448859e-8e9a-53a2-954f-5e189449354a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL15014',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 116582,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 400 T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2016}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Saving data for LL15014: {'auction_closing_time': 1774883682.0, 'created_time': 1774263259.556536, 'last_price_update_time': 1774809597.249484}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL15014') HTTP/1.1" 204 0
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW82569%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Scrape type for WW82569: 0
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Scrape type for WZ32773: 2
2026-03-29 18:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-29 18:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339c61d7-3eb8-5336-9ec8-e791c28e59e5, identifier: WZ32773
2026-03-29 18:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-29 18:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773
2026-03-29 18:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339c61d7-3eb8-5336-9ec8-e791c28e59e5 with identifier: WZ32773 to the API
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:51:50Z',
'fuel_type': 'petrol',
'id': '339c61d7-3eb8-5336-9ec8-e791c28e59e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ32773',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 153049,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-02',
'seller_name': None,
'title': 'Opel Astra 1.6 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2003}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Saving data for WZ32773: {'auction_closing_time': 1774885910.0, 'created_time': 1774034715.107828, 'last_price_update_time': 1774809597.676525}
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ32773') HTTP/1.1" 204 0
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-29 18:39:57 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-29 18:39:57 [auto1.de] INFO: Scrape type for BN83173: 2
2026-03-29 18:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-29 18:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with scrape type 2
2026-03-29 18:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8, identifier: BN83173
2026-03-29 18:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-29 18:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-29 18:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173 to the API
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:44:32Z',
'fuel_type': 'petrol',
'id': 'f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN83173',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 215615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-08',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Style Edition',
'transmission': 'manual',
'trim': 'Style Edition',
'year': 2009}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Saving data for BN83173: {'auction_closing_time': 1774885472.0, 'created_time': 1774608210.551016, 'last_price_update_time': 1774809598.267442}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN83173') HTTP/1.1" 204 0
2026-03-29 18:39:58 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 6740 | hits on page: 40
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Scrape type for GR33012: 0
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Scrape type for AM60777: 2
2026-03-29 18:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777
2026-03-29 18:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5583474a-661d-57c3-a843-cbaa4f44267f with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5583474a-661d-57c3-a843-cbaa4f44267f with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5583474a-661d-57c3-a843-cbaa4f44267f, identifier: AM60777
2026-03-29 18:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777
2026-03-29 18:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777
2026-03-29 18:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777 to the API
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:49:20Z',
'fuel_type': 'diesel',
'id': '5583474a-661d-57c3-a843-cbaa4f44267f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM60777',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 154026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Skoda Yeti 2.0 TDI Drive',
'transmission': 'manual',
'trim': 'Drive',
'year': 2017}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Saving data for AM60777: {'auction_closing_time': 1774885760.0, 'created_time': 1774510532.068707, 'last_price_update_time': 1774809598.743593}
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM60777') HTTP/1.1" 204 0
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-29 18:39:58 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-29 18:39:58 [auto1.de] INFO: Scrape type for MH03365: 2
2026-03-29 18:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-29 18:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67c06ff0-b109-55ed-974b-feef205979f2 with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67c06ff0-b109-55ed-974b-feef205979f2 with scrape type 2
2026-03-29 18:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67c06ff0-b109-55ed-974b-feef205979f2, identifier: MH03365
2026-03-29 18:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-29 18:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365
2026-03-29 18:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67c06ff0-b109-55ed-974b-feef205979f2 with identifier: MH03365 to the API
2026-03-29 18:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:32Z',
'fuel_type': 'petrol',
'id': '67c06ff0-b109-55ed-974b-feef205979f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH03365',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 119893,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-26',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Saving data for MH03365: {'auction_closing_time': 1774884992.0, 'created_time': 1773429467.988775, 'last_price_update_time': 1774809599.186561}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH03365') HTTP/1.1" 204 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR44160%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP99988%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for GP99988: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for UK52286: 2
2026-03-29 18:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-29 18:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5c3948-cac5-5680-8af5-311903ebdecc with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae5c3948-cac5-5680-8af5-311903ebdecc with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5c3948-cac5-5680-8af5-311903ebdecc, identifier: UK52286
2026-03-29 18:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-29 18:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286
2026-03-29 18:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5c3948-cac5-5680-8af5-311903ebdecc with identifier: UK52286 to the API
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:33:30Z',
'fuel_type': 'diesel',
'id': 'ae5c3948-cac5-5680-8af5-311903ebdecc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK52286',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 196212,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-22',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2015}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Saving data for UK52286: {'auction_closing_time': 1774884810.0, 'created_time': 1774522248.292621, 'last_price_update_time': 1774809599.612567}
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK52286') HTTP/1.1" 204 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD42848%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for XD42848: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for MZ39955: 0
2026-03-29 18:39:59 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-29 18:39:59 [auto1.de] INFO: Scrape type for FA96638: 2
2026-03-29 18:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-29 18:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb479ad5-39ea-51e7-ae4c-96d684216893 with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb479ad5-39ea-51e7-ae4c-96d684216893 with scrape type 2
2026-03-29 18:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb479ad5-39ea-51e7-ae4c-96d684216893, identifier: FA96638
2026-03-29 18:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-29 18:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-29 18:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638 to the API
2026-03-29 18:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:14:53Z',
'fuel_type': 'petrol',
'id': 'cb479ad5-39ea-51e7-ae4c-96d684216893',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA96638',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 137198,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-11',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2014}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Saving data for FA96638: {'auction_closing_time': 1774883693.0, 'created_time': 1774608435.155741, 'last_price_update_time': 1774809600.232038}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA96638') HTTP/1.1" 204 0
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR52886%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Scrape type for XR52886: 0
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Scrape type for TE07006: 2
2026-03-29 18:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-29 18:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd, identifier: TE07006
2026-03-29 18:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-29 18:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006
2026-03-29 18:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 286f6afd-b19a-5c75-9fe3-ae17bc758dbd with identifier: TE07006 to the API
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:00Z',
'fuel_type': 'diesel',
'id': '286f6afd-b19a-5c75-9fe3-ae17bc758dbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE07006',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 141703,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-29',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Saving data for TE07006: {'auction_closing_time': 1774884360.0, 'created_time': 1774522570.894017, 'last_price_update_time': 1774809600.688176}
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE07006') HTTP/1.1" 204 0
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Scrape type for FE62159: 0
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-29 18:40:00 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-29 18:40:00 [auto1.de] INFO: Scrape type for ZK01329: 2
2026-03-29 18:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329
2026-03-29 18:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with scrape type 2
2026-03-29 18:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa, identifier: ZK01329
2026-03-29 18:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329
2026-03-29 18:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329
2026-03-29 18:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa with identifier: ZK01329 to the API
2026-03-29 18:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:29:42Z',
'fuel_type': 'petrol',
'id': 'a760b8e4-f3dc-5640-ad0c-ca15f7fe3bfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK01329',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Colt',
'odometer': 67398,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-27',
'seller_name': None,
'title': 'Mitsubishi Colt 1.1 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2009}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Saving data for ZK01329: {'auction_closing_time': 1774884582.0, 'created_time': 1774636630.486562, 'last_price_update_time': 1774809601.197514}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK01329') HTTP/1.1" 204 0
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC12469%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for MC12469: 0
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for TB37654: 2
2026-03-29 18:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-29 18:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with scrape type 2
2026-03-29 18:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with scrape type 2
2026-03-29 18:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2edb494e-f9d4-53f6-9321-c8c7a3e42653, identifier: TB37654
2026-03-29 18:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-29 18:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654
2026-03-29 18:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2edb494e-f9d4-53f6-9321-c8c7a3e42653 with identifier: TB37654 to the API
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:35:36Z',
'fuel_type': 'petrol',
'id': '2edb494e-f9d4-53f6-9321-c8c7a3e42653',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB37654',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 81108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-09',
'seller_name': None,
'title': 'Volvo V40 1.6 T2 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2014}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Saving data for TB37654: {'auction_closing_time': 1774884936.0, 'created_time': 1774522476.640558, 'last_price_update_time': 1774809601.822057}
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB37654') HTTP/1.1" 204 0
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for SS30943: 0
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for BB15265: 0
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH02243%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for RH02243: 0
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-29 18:40:01 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-29 18:40:01 [auto1.de] INFO: Scrape type for PH96915: 2
2026-03-29 18:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-29 18:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 545c7f75-9ff7-5f91-94be-70af58c45add with scrape type 2
2026-03-29 18:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 545c7f75-9ff7-5f91-94be-70af58c45add with scrape type 2
2026-03-29 18:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 545c7f75-9ff7-5f91-94be-70af58c45add, identifier: PH96915
2026-03-29 18:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-29 18:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-29 18:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915 to the API
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:53:57Z',
'fuel_type': 'diesel',
'id': '545c7f75-9ff7-5f91-94be-70af58c45add',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH96915',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 51274,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-21',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Saving data for PH96915: {'auction_closing_time': 1774886037.0, 'created_time': 1773775869.779726, 'last_price_update_time': 1774809602.372399}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH96915') HTTP/1.1" 204 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for DY95504: 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for EM07898: 2
2026-03-29 18:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-29 18:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with scrape type 2
2026-03-29 18:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with scrape type 2
2026-03-29 18:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06, identifier: EM07898
2026-03-29 18:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-29 18:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-29 18:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898 to the API
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:24:25Z',
'fuel_type': 'diesel',
'id': '450f596c-fd6c-5a87-9dd4-97fd03dd6f06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM07898',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 217595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-13',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2015}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Saving data for EM07898: {'auction_closing_time': 1774884265.0, 'created_time': 1773343257.987719, 'last_price_update_time': 1774809602.83934}
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM07898') HTTP/1.1" 204 0
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-29 18:40:02 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-29 18:40:02 [auto1.de] INFO: Scrape type for EP05122: 2
2026-03-29 18:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-29 18:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7267485-db74-570b-a230-cc5d837feab2 with scrape type 2
2026-03-29 18:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7267485-db74-570b-a230-cc5d837feab2 with scrape type 2
2026-03-29 18:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7267485-db74-570b-a230-cc5d837feab2, identifier: EP05122
2026-03-29 18:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-29 18:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-29 18:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122 to the API
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:03:29Z',
'fuel_type': 'diesel',
'id': 'a7267485-db74-570b-a230-cc5d837feab2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP05122',
'listing': 'auction',
'make': 'Opel',
'model': 'Vectra',
'odometer': 238179,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-21',
'seller_name': None,
'title': 'Opel Vectra 3.0 V6 CDTI Cosmo Plus',
'transmission': 'automatic',
'trim': 'Cosmo Plus',
'year': 2007}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Saving data for EP05122: {'auction_closing_time': 1774883009.0, 'created_time': 1773686292.837456, 'last_price_update_time': 1774809603.414972}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP05122') HTTP/1.1" 204 0
2026-03-29 18:40:03 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for YT52370: 2
2026-03-29 18:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370
2026-03-29 18:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with scrape type 2
2026-03-29 18:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with scrape type 2
2026-03-29 18:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3, identifier: YT52370
2026-03-29 18:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370
2026-03-29 18:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370
2026-03-29 18:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3 with identifier: YT52370 to the API
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:33:14Z',
'fuel_type': 'diesel',
'id': '9a84dcd6-cb81-5ecd-9ee6-12dfb6b459a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT52370',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 160574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-12',
'seller_name': None,
'title': 'BMW 3er 320d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2020}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Saving data for YT52370: {'auction_closing_time': 1774884794.0, 'created_time': 1773303214.203218, 'last_price_update_time': 1774809603.829895}
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT52370') HTTP/1.1" 204 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13721%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for CD13721: 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02810%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for WF02810: 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for PG24274: 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL84937%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for TL84937: 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ88633%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for HJ88633: 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75597%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for NY75597: 0
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-29 18:40:03 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-29 18:40:03 [auto1.de] INFO: Scrape type for GU59921: 2
2026-03-29 18:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921
2026-03-29 18:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with scrape type 2
2026-03-29 18:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d5ce38-9bc7-5269-896e-b4e77e9115e6, identifier: GU59921
2026-03-29 18:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR50591%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Scrape type for KR50591: 0
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-29 18:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921
2026-03-29 18:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921
2026-03-29 18:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d5ce38-9bc7-5269-896e-b4e77e9115e6 with identifier: GU59921 to the API
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:29Z',
'fuel_type': 'diesel',
'id': 'a4d5ce38-9bc7-5269-896e-b4e77e9115e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU59921',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 32870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2020}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Saving data for GU59921: {'auction_closing_time': 1774885169.0, 'created_time': 1774264201.621354, 'last_price_update_time': 1774809604.434371}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU59921') HTTP/1.1" 204 0
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP10507%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Scrape type for PP10507: 2
2026-03-29 18:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507
2026-03-29 18:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f22ab60-d7ac-5294-a564-e39de3f1f50a with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f22ab60-d7ac-5294-a564-e39de3f1f50a with scrape type 2
2026-03-29 18:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f22ab60-d7ac-5294-a564-e39de3f1f50a, identifier: PP10507
2026-03-29 18:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507
2026-03-29 18:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507
2026-03-29 18:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f22ab60-d7ac-5294-a564-e39de3f1f50a with identifier: PP10507 to the API
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:23:04Z',
'fuel_type': 'petrol',
'id': '5f22ab60-d7ac-5294-a564-e39de3f1f50a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP10507',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 137625,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-06',
'seller_name': None,
'title': 'Suzuki Swift 1.2 Club 4x4',
'transmission': 'manual',
'trim': 'Club 4x4',
'year': 2013}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP10507%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Saving data for PP10507: {'auction_closing_time': 1774884184.0, 'created_time': 1774723078.797411, 'last_price_update_time': 1774809604.946225}
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP10507') HTTP/1.1" 204 0
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-29 18:40:04 [auto1.de] INFO: Scrape type for SD15904: 0
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-29 18:40:04 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-29 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Scrape type for ME06173: 2
2026-03-29 18:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173
2026-03-29 18:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e, identifier: ME06173
2026-03-29 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173
2026-03-29 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173
2026-03-29 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173 to the API
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:02:29Z',
'fuel_type': 'diesel',
'id': 'ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME06173',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 273530,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-28',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2011}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Saving data for ME06173: {'auction_closing_time': 1774882949.0, 'created_time': 1774510545.04557, 'last_price_update_time': 1774809605.44077}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME06173') HTTP/1.1" 204 0
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Scrape type for BG81908: 2
2026-03-29 18:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-29 18:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with scrape type 2
2026-03-29 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1582a76a-7768-5657-bbaa-47d7cb91b1e1, identifier: BG81908
2026-03-29 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-29 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-29 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908 to the API
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:07Z',
'fuel_type': 'petrol',
'id': '1582a76a-7768-5657-bbaa-47d7cb91b1e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG81908',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 6474,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2022}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Saving data for BG81908: {'auction_closing_time': 1774883467.0, 'created_time': 1774294694.658125, 'last_price_update_time': 1774809605.934067}
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG81908') HTTP/1.1" 204 0
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-29 18:40:05 [auto1.de] INFO: Scrape type for GJ75374: 0
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-29 18:40:05 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Scrape type for HH04622: 2
2026-03-29 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-29 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1073c23e-5468-5ddc-aeec-3344b9e071b0 with scrape type 2
2026-03-29 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1073c23e-5468-5ddc-aeec-3344b9e071b0 with scrape type 2
2026-03-29 18:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1073c23e-5468-5ddc-aeec-3344b9e071b0, identifier: HH04622
2026-03-29 18:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-29 18:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-29 18:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622 to the API
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:50:57Z',
'fuel_type': 'petrol',
'id': '1073c23e-5468-5ddc-aeec-3344b9e071b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH04622',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 231255,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-28',
'seller_name': None,
'title': 'Renault Clio 1.2 Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Saving data for HH04622: {'auction_closing_time': 1774885857.0, 'created_time': 1773302806.650967, 'last_price_update_time': 1774809606.441948}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH04622') HTTP/1.1" 204 0
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Scrape type for EV97888: 2
2026-03-29 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888
2026-03-29 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e42c9a0-88b2-5573-9408-d43f7b85871e with scrape type 2
2026-03-29 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e42c9a0-88b2-5573-9408-d43f7b85871e with scrape type 2
2026-03-29 18:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e42c9a0-88b2-5573-9408-d43f7b85871e, identifier: EV97888
2026-03-29 18:40:06 [scrapy.extensions.logstats] INFO: Crawled 64 pages (at 11 pages/min), scraped 448 items (at 118 items/min)
2026-03-29 18:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888
2026-03-29 18:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888
2026-03-29 18:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e42c9a0-88b2-5573-9408-d43f7b85871e with identifier: EV97888 to the API
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:00:04Z',
'fuel_type': 'petrol',
'id': '9e42c9a0-88b2-5573-9408-d43f7b85871e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV97888',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 101872,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-26',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-29 18:40:06 [auto1.de] INFO: Saving data for EV97888: {'auction_closing_time': 1774882804.0, 'created_time': 1773946781.881588, 'last_price_update_time': 1774809606.96974}
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV97888') HTTP/1.1" 204 0
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-29 18:40:06 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-29 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Scrape type for PL64975: 2
2026-03-29 18:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-29 18:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d678ceb2-4da1-5e44-849d-a154c1377168 with scrape type 2
2026-03-29 18:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d678ceb2-4da1-5e44-849d-a154c1377168 with scrape type 2
2026-03-29 18:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d678ceb2-4da1-5e44-849d-a154c1377168, identifier: PL64975
2026-03-29 18:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-29 18:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-29 18:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975 to the API
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:50:21Z',
'fuel_type': 'hybrid',
'id': 'd678ceb2-4da1-5e44-849d-a154c1377168',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL64975',
'listing': 'auction',
'make': 'Toyota',
'model': 'Prius',
'odometer': 112537,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-10',
'seller_name': None,
'title': 'Toyota Prius 1.5',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Saving data for PL64975: {'auction_closing_time': 1774885821.0, 'created_time': 1774291369.830317, 'last_price_update_time': 1774809607.425382}
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL64975') HTTP/1.1" 204 0
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG10671%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Scrape type for BG10671: 0
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF36424%27 HTTP/1.1" 200 None
2026-03-29 18:40:07 [auto1.de] INFO: Scrape type for JF36424: 0
2026-03-29 18:40:07 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-29 18:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:08 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Scrape type for AN46464: 2
2026-03-29 18:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-29 18:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6351d24-e791-578a-85a9-ad351bd10293 with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6351d24-e791-578a-85a9-ad351bd10293 with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6351d24-e791-578a-85a9-ad351bd10293, identifier: AN46464
2026-03-29 18:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-29 18:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-29 18:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464 to the API
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:11:21Z',
'fuel_type': 'diesel',
'id': 'a6351d24-e791-578a-85a9-ad351bd10293',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN46464',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 171218,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-12',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Lounge BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge BlueMotion Tech',
'year': 2015}
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Saving data for AN46464: {'auction_closing_time': 1774883481.0, 'created_time': 1774607783.191696, 'last_price_update_time': 1774809608.821009}
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN46464') HTTP/1.1" 204 0
2026-03-29 18:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-29 18:40:08 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-29 18:40:08 [auto1.de] INFO: Scrape type for HP37567: 2
2026-03-29 18:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-29 18:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d3d63c-9514-5cea-9df5-dd64be066daf with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d3d63c-9514-5cea-9df5-dd64be066daf with scrape type 2
2026-03-29 18:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d3d63c-9514-5cea-9df5-dd64be066daf, identifier: HP37567
2026-03-29 18:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-29 18:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567
2026-03-29 18:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d3d63c-9514-5cea-9df5-dd64be066daf with identifier: HP37567 to the API
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:57:23Z',
'fuel_type': 'petrol',
'id': '25d3d63c-9514-5cea-9df5-dd64be066daf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP37567',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 188603,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2015}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Saving data for HP37567: {'auction_closing_time': 1774886243.0, 'created_time': 1774522545.479878, 'last_price_update_time': 1774809609.233859}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP37567') HTTP/1.1" 204 0
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Scrape type for AN41414: 2
2026-03-29 18:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-29 18:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a6b024f-8851-548e-b542-c66f26fc002d with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a6b024f-8851-548e-b542-c66f26fc002d with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a6b024f-8851-548e-b542-c66f26fc002d, identifier: AN41414
2026-03-29 18:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-29 18:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414
2026-03-29 18:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a6b024f-8851-548e-b542-c66f26fc002d with identifier: AN41414 to the API
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:43:09Z',
'fuel_type': 'petrol',
'id': '3a6b024f-8851-548e-b542-c66f26fc002d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN41414',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 103179,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-29',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Style Salsa',
'transmission': 'manual',
'trim': 'Style Salsa',
'year': 2014}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Saving data for AN41414: {'auction_closing_time': 1774885389.0, 'created_time': 1774521693.272948, 'last_price_update_time': 1774809609.732786}
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN41414') HTTP/1.1" 204 0
2026-03-29 18:40:09 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-29 18:40:09 [auto1.de] INFO: Scrape type for YR25980: 2
2026-03-29 18:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-29 18:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1315275e-81ac-5ae2-a803-94d2ead6b39f with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1315275e-81ac-5ae2-a803-94d2ead6b39f with scrape type 2
2026-03-29 18:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1315275e-81ac-5ae2-a803-94d2ead6b39f, identifier: YR25980
2026-03-29 18:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-29 18:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980
2026-03-29 18:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1315275e-81ac-5ae2-a803-94d2ead6b39f with identifier: YR25980 to the API
2026-03-29 18:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:29:49Z',
'fuel_type': 'diesel',
'id': '1315275e-81ac-5ae2-a803-94d2ead6b39f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR25980',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 72123,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-26',
'seller_name': None,
'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
'transmission': 'manual',
'trim': 'lang Tourer Edition',
'year': 2019}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Saving data for YR25980: {'auction_closing_time': 1774884589.0, 'created_time': 1774521421.949189, 'last_price_update_time': 1774809610.150398}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR25980') HTTP/1.1" 204 0
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Scrape type for ZY58366: 2
2026-03-29 18:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366
2026-03-29 18:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c9b454-c414-501f-b4ba-a2633e7b053f with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89c9b454-c414-501f-b4ba-a2633e7b053f with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89c9b454-c414-501f-b4ba-a2633e7b053f, identifier: ZY58366
2026-03-29 18:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366
2026-03-29 18:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366
2026-03-29 18:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366 to the API
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:32:54Z',
'fuel_type': 'petrol',
'id': '89c9b454-c414-501f-b4ba-a2633e7b053f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY58366',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 82525,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-08',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2019}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Saving data for ZY58366: {'auction_closing_time': 1774884774.0, 'created_time': 1774510542.257214, 'last_price_update_time': 1774809610.61145}
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY58366') HTTP/1.1" 204 0
2026-03-29 18:40:10 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-29 18:40:10 [auto1.de] INFO: Scrape type for UT75774: 2
2026-03-29 18:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774
2026-03-29 18:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with scrape type 2
2026-03-29 18:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23431afd-dcda-592e-92ff-3aa35ba0d9c7, identifier: UT75774
2026-03-29 18:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774
2026-03-29 18:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774
2026-03-29 18:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23431afd-dcda-592e-92ff-3aa35ba0d9c7 with identifier: UT75774 to the API
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:14:51Z',
'fuel_type': 'diesel',
'id': '23431afd-dcda-592e-92ff-3aa35ba0d9c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT75774',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 193250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-03',
'seller_name': None,
'title': 'BMW X5 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Saving data for UT75774: {'auction_closing_time': 1774883691.0, 'created_time': 1773344354.189045, 'last_price_update_time': 1774809611.034534}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT75774') HTTP/1.1" 204 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD69180%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for CD69180: 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for LT34656: 2
2026-03-29 18:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-29 18:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce2dca40-f721-58f7-bcb6-a8858dc1fa78, identifier: LT34656
2026-03-29 18:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-29 18:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-29 18:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656 to the API
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:47:16Z',
'fuel_type': 'diesel',
'id': 'ce2dca40-f721-58f7-bcb6-a8858dc1fa78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT34656',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 147957,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Black Shadow 4x4',
'transmission': 'manual',
'trim': 'Black Shadow 4x4',
'year': 2017}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Saving data for LT34656: {'auction_closing_time': 1774885636.0, 'created_time': 1773831013.481671, 'last_price_update_time': 1774809611.761224}
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT34656') HTTP/1.1" 204 0
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-29 18:40:11 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-29 18:40:11 [auto1.de] INFO: Scrape type for MM42204: 2
2026-03-29 18:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-29 18:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ac0a31-65f1-55fc-9702-6098d4b16fee with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80ac0a31-65f1-55fc-9702-6098d4b16fee with scrape type 2
2026-03-29 18:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80ac0a31-65f1-55fc-9702-6098d4b16fee, identifier: MM42204
2026-03-29 18:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-29 18:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-29 18:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204 to the API
2026-03-29 18:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:09:54Z',
'fuel_type': 'diesel',
'id': '80ac0a31-65f1-55fc-9702-6098d4b16fee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM42204',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 194390,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-10',
'seller_name': None,
'title': 'BMW 3er 325d GT M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2016}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Saving data for MM42204: {'auction_closing_time': 1774883394.0, 'created_time': 1773302884.786969, 'last_price_update_time': 1774809612.221224}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM42204') HTTP/1.1" 204 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for VX90434: 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL25204%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for LL25204: 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for YT23493: 2
2026-03-29 18:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-29 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261ba68c-bdfc-5869-8653-b5da35019a0f with scrape type 2
2026-03-29 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261ba68c-bdfc-5869-8653-b5da35019a0f with scrape type 2
2026-03-29 18:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261ba68c-bdfc-5869-8653-b5da35019a0f, identifier: YT23493
2026-03-29 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-29 18:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-29 18:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493 to the API
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:41:33Z',
'fuel_type': 'diesel',
'id': '261ba68c-bdfc-5869-8653-b5da35019a0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT23493',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 257620,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-31',
'seller_name': None,
'title': 'BMW 1er 123d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Saving data for YT23493: {'auction_closing_time': 1774885293.0, 'created_time': 1773228656.593994, 'last_price_update_time': 1774809612.816104}
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT23493') HTTP/1.1" 204 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08080%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for AE08080: 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB50562%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for UB50562: 0
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-29 18:40:12 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-29 18:40:12 [auto1.de] INFO: Scrape type for WW12135: 2
2026-03-29 18:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-29 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with scrape type 2
2026-03-29 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with scrape type 2
2026-03-29 18:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed, identifier: WW12135
2026-03-29 18:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-29 18:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-29 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135 to the API
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:05:26Z',
'fuel_type': 'petrol',
'id': '1706d7f4-4bbf-579d-92b5-87c72bdd2eed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW12135',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 43320,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-23',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Club BlueMotion Tech',
'transmission': 'manual',
'trim': 'Club BlueMotion Tech',
'year': 2015}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Saving data for WW12135: {'auction_closing_time': 1774883126.0, 'created_time': 1774251382.950715, 'last_price_update_time': 1774809613.364661}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW12135') HTTP/1.1" 204 0
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Scrape type for HD30169: 0
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD55722%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Scrape type for MD55722: 0
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF47074%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Scrape type for EF47074: 0
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Scrape type for BR24647: 2
2026-03-29 18:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-29 18:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867c14e7-d7da-5f28-89f0-2b601d5d4351 with scrape type 2
2026-03-29 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 867c14e7-d7da-5f28-89f0-2b601d5d4351 with scrape type 2
2026-03-29 18:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 867c14e7-d7da-5f28-89f0-2b601d5d4351, identifier: BR24647
2026-03-29 18:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-29 18:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-29 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647 to the API
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:53:13Z',
'fuel_type': 'petrol',
'id': '867c14e7-d7da-5f28-89f0-2b601d5d4351',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR24647',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 30706,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-08',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2021}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-29 18:40:13 [auto1.de] INFO: Saving data for BR24647: {'auction_closing_time': 1774885993.0, 'created_time': 1773302856.422645, 'last_price_update_time': 1774809613.97594}
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR24647') HTTP/1.1" 204 0
2026-03-29 18:40:13 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-29 18:40:13 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE84104%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for DE84104: 0
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for WZ86962: 2
2026-03-29 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-29 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf87a281-581b-55a7-b337-f760e7e20505 with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf87a281-581b-55a7-b337-f760e7e20505 with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf87a281-581b-55a7-b337-f760e7e20505, identifier: WZ86962
2026-03-29 18:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-29 18:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962
2026-03-29 18:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf87a281-581b-55a7-b337-f760e7e20505 with identifier: WZ86962 to the API
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:00Z',
'fuel_type': 'diesel',
'id': 'cf87a281-581b-55a7-b337-f760e7e20505',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ86962',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 150943,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-03',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2022}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Saving data for WZ86962: {'auction_closing_time': 1774884240.0, 'created_time': 1773427330.107369, 'last_price_update_time': 1774809614.436323}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ86962') HTTP/1.1" 204 0
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF73158%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for FF73158: 0
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD30774%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for ZD30774: 0
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Scrape type for NJ66077: 2
2026-03-29 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077
2026-03-29 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e30b56-18ba-5db7-ad81-a312262d174c with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91e30b56-18ba-5db7-ad81-a312262d174c with scrape type 2
2026-03-29 18:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91e30b56-18ba-5db7-ad81-a312262d174c, identifier: NJ66077
2026-03-29 18:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-29 18:40:14 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-29 18:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077
2026-03-29 18:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077
2026-03-29 18:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91e30b56-18ba-5db7-ad81-a312262d174c with identifier: NJ66077 to the API
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:55:53Z',
'fuel_type': 'petrol',
'id': '91e30b56-18ba-5db7-ad81-a312262d174c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ66077',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 35091,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-24',
'seller_name': None,
'title': 'Hyundai i10 1.2 Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2014}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-29 18:40:14 [auto1.de] INFO: Saving data for NJ66077: {'auction_closing_time': 1774886153.0, 'created_time': 1774636595.525794, 'last_price_update_time': 1774809614.893381}
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ66077') HTTP/1.1" 204 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK09737%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for UK09737: 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for DY67323: 2
2026-03-29 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-29 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccfb5977-0cd9-5059-94f2-2521608a8435 with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccfb5977-0cd9-5059-94f2-2521608a8435 with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccfb5977-0cd9-5059-94f2-2521608a8435, identifier: DY67323
2026-03-29 18:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-29 18:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-29 18:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323 to the API
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:54:23Z',
'fuel_type': 'hybrid',
'id': 'ccfb5977-0cd9-5059-94f2-2521608a8435',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY67323',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 57125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-28',
'seller_name': None,
'title': 'Audi Q3 Sportback 45 TFSIe',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Saving data for DY67323: {'auction_closing_time': 1774886063.0, 'created_time': 1773133804.462022, 'last_price_update_time': 1774809615.44528}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY67323') HTTP/1.1" 204 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT21792%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for MT21792: 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for AV13612: 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY04572%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for FY04572: 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90770%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for NG90770: 0
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-29 18:40:15 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Scrape type for JY21775: 2
2026-03-29 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-29 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with scrape type 2
2026-03-29 18:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9, identifier: JY21775
2026-03-29 18:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-29 18:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775
2026-03-29 18:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5debbf9e-e055-55b0-8ebc-dd5881b8b2a9 with identifier: JY21775 to the API
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:21:00Z',
'fuel_type': 'diesel',
'id': '5debbf9e-e055-55b0-8ebc-dd5881b8b2a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY21775',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 254371,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-05',
'seller_name': None,
'title': 'Ford Grand C-Max 1.6 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2014}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-29 18:40:15 [auto1.de] INFO: Saving data for JY21775: {'auction_closing_time': 1774884060.0, 'created_time': 1774522250.937504, 'last_price_update_time': 1774809615.917355}
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY21775') HTTP/1.1" 204 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for DL69348: 2
2026-03-29 18:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-29 18:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ece55db-40b9-5ea8-911a-7c385298c104 with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ece55db-40b9-5ea8-911a-7c385298c104 with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ece55db-40b9-5ea8-911a-7c385298c104, identifier: DL69348
2026-03-29 18:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-29 18:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-29 18:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348 to the API
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 421,
'expiration_date': '2026-03-30T15:36:42Z',
'fuel_type': 'diesel',
'id': '0ece55db-40b9-5ea8-911a-7c385298c104',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL69348',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 137317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-06',
'seller_name': None,
'title': 'Volkswagen Touareg 4.0 TDI Atmosphere 4Motion',
'transmission': 'automatic',
'trim': 'Atmosphere 4Motion',
'year': 2020}
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Saving data for DL69348: {'auction_closing_time': 1774885002.0, 'created_time': 1773305795.149433, 'last_price_update_time': 1774809616.498236}
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL69348') HTTP/1.1" 204 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX23620%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for NX23620: 0
2026-03-29 18:40:16 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-29 18:40:16 [auto1.de] INFO: Scrape type for XU56450: 2
2026-03-29 18:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-29 18:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93dd912f-6f28-5c89-8314-eed5972696df with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93dd912f-6f28-5c89-8314-eed5972696df with scrape type 2
2026-03-29 18:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93dd912f-6f28-5c89-8314-eed5972696df, identifier: XU56450
2026-03-29 18:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-29 18:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-29 18:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450 to the API
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:56Z',
'fuel_type': 'gas',
'id': '93dd912f-6f28-5c89-8314-eed5972696df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU56450',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 222655,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-24',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 Kasten Economy EcoFuel',
'transmission': 'manual',
'trim': 'Kasten Economy EcoFuel',
'year': 2008}
2026-03-29 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Saving data for XU56450: {'auction_closing_time': 1774885856.0, 'created_time': 1773308232.649924, 'last_price_update_time': 1774809617.004451}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU56450') HTTP/1.1" 204 0
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Scrape type for BC73225: 2
2026-03-29 18:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-29 18:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70, identifier: BC73225
2026-03-29 18:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-29 18:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-29 18:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225 to the API
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:23:20Z',
'fuel_type': 'petrol',
'id': '2a8a59fe-ffb6-5ce6-9098-02878aa44e70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC73225',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Kalos',
'odometer': 39472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-18',
'seller_name': None,
'title': 'Chevrolet Kalos 1.4 SX',
'transmission': 'manual',
'trim': 'SX',
'year': 2009}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Saving data for BC73225: {'auction_closing_time': 1774884200.0, 'created_time': 1773380475.076288, 'last_price_update_time': 1774809617.484555}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC73225') HTTP/1.1" 204 0
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL62100%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Scrape type for HL62100: 0
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-29 18:40:17 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Scrape type for BT35414: 2
2026-03-29 18:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-29 18:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a639d3e-e7c2-5ee6-b485-571945b50668 with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a639d3e-e7c2-5ee6-b485-571945b50668 with scrape type 2
2026-03-29 18:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a639d3e-e7c2-5ee6-b485-571945b50668, identifier: BT35414
2026-03-29 18:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-29 18:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-29 18:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414 to the API
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:29:13Z',
'fuel_type': 'petrol',
'id': '9a639d3e-e7c2-5ee6-b485-571945b50668',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT35414',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 75308,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-10',
'seller_name': None,
'title': 'Porsche Macan 2.0',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-29 18:40:17 [auto1.de] INFO: Saving data for BT35414: {'auction_closing_time': 1774884553.0, 'created_time': 1774608239.871469, 'last_price_update_time': 1774809617.977554}
2026-03-29 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT35414') HTTP/1.1" 204 0
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Scrape type for DP87789: 2
2026-03-29 18:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-29 18:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681d9114-5fc1-5dbd-8986-8212c7fbac96 with scrape type 2
2026-03-29 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681d9114-5fc1-5dbd-8986-8212c7fbac96 with scrape type 2
2026-03-29 18:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 681d9114-5fc1-5dbd-8986-8212c7fbac96, identifier: DP87789
2026-03-29 18:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-29 18:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-29 18:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789 to the API
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:40:26Z',
'fuel_type': 'diesel',
'id': '681d9114-5fc1-5dbd-8986-8212c7fbac96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP87789',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 50333,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-12',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2019}
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Saving data for DP87789: {'auction_closing_time': 1774885226.0, 'created_time': 1773402580.974435, 'last_price_update_time': 1774809618.703918}
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP87789') HTTP/1.1" 204 0
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-29 18:40:18 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-29 18:40:18 [auto1.de] INFO: Scrape type for BJ94385: 2
2026-03-29 18:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385
2026-03-29 18:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with scrape type 2
2026-03-29 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with scrape type 2
2026-03-29 18:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c, identifier: BJ94385
2026-03-29 18:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385
2026-03-29 18:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385
2026-03-29 18:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4c7c257-c4a7-5e84-ab2c-716a24c6c73c with identifier: BJ94385 to the API
2026-03-29 18:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:12:34Z',
'fuel_type': 'diesel',
'id': 'b4c7c257-c4a7-5e84-ab2c-716a24c6c73c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ94385',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 142183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-14',
'seller_name': None,
'title': 'Ford Transit 1.5 TDCi Kasten Trend',
'transmission': 'manual',
'trim': 'Kasten Trend',
'year': 2016}
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-29 18:40:19 [auto1.de] INFO: Saving data for BJ94385: {'auction_closing_time': 1774883554.0, 'created_time': 1773402199.389185, 'last_price_update_time': 1774809619.124607}
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ94385') HTTP/1.1" 204 0
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-29 18:40:19 [auto1.de] INFO: Scrape type for EN83370: 2
2026-03-29 18:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-29 18:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74ef32a-1a46-5836-9cd9-536cb191af33 with scrape type 2
2026-03-29 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c74ef32a-1a46-5836-9cd9-536cb191af33 with scrape type 2
2026-03-29 18:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c74ef32a-1a46-5836-9cd9-536cb191af33, identifier: EN83370
2026-03-29 18:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-29 18:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-29 18:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370 to the API
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:26:40Z',
'fuel_type': 'petrol',
'id': 'c74ef32a-1a46-5836-9cd9-536cb191af33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN83370',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 114215,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-07',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-29 18:40:19 [auto1.de] INFO: Saving data for EN83370: {'auction_closing_time': 1774884400.0, 'created_time': 1774607748.40188, 'last_price_update_time': 1774809619.580056}
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN83370') HTTP/1.1" 204 0
2026-03-29 18:40:19 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-29 18:40:19 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-29 18:40:19 [auto1.de] INFO: Scrape type for AH38821: 2
2026-03-29 18:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-29 18:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cff92bc-7630-5cd0-9978-5f92ab76c302 with scrape type 2
2026-03-29 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cff92bc-7630-5cd0-9978-5f92ab76c302 with scrape type 2
2026-03-29 18:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cff92bc-7630-5cd0-9978-5f92ab76c302, identifier: AH38821
2026-03-29 18:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-29 18:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821
2026-03-29 18:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cff92bc-7630-5cd0-9978-5f92ab76c302 with identifier: AH38821 to the API
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:11:32Z',
'fuel_type': 'petrol',
'id': '4cff92bc-7630-5cd0-9978-5f92ab76c302',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH38821',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 30204,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-28',
'seller_name': None,
'title': 'Renault Captur 0.9 TCe Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2015}
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-29 18:40:19 [auto1.de] INFO: Saving data for AH38821: {'auction_closing_time': 1774883492.0, 'created_time': 1774118545.112776, 'last_price_update_time': 1774809619.99393}
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH38821') HTTP/1.1" 204 0
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Scrape type for WZ27429: 0
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Scrape type for MC36419: 2
2026-03-29 18:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-29 18:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabbf226-ded2-5c83-955d-c86e7083f3ed with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eabbf226-ded2-5c83-955d-c86e7083f3ed with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eabbf226-ded2-5c83-955d-c86e7083f3ed, identifier: MC36419
2026-03-29 18:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA59196%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Scrape type for SA59196: 0
2026-03-29 18:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-29 18:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-29 18:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419 to the API
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:33:44Z',
'fuel_type': 'petrol',
'id': 'eabbf226-ded2-5c83-955d-c86e7083f3ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC36419',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 112532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-23',
'seller_name': None,
'title': 'Opel Adam 1.4 Jam',
'transmission': 'manual',
'trim': 'Jam',
'year': 2014}
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Saving data for MC36419: {'auction_closing_time': 1774884824.0, 'created_time': 1773945772.116049, 'last_price_update_time': 1774809620.506447}
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC36419') HTTP/1.1" 204 0
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-29 18:40:20 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-29 18:40:20 [auto1.de] INFO: Scrape type for YF83541: 2
2026-03-29 18:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-29 18:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e56f4e5-e247-56cf-a2b9-697d39dca00a with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e56f4e5-e247-56cf-a2b9-697d39dca00a with scrape type 2
2026-03-29 18:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e56f4e5-e247-56cf-a2b9-697d39dca00a, identifier: YF83541
2026-03-29 18:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-29 18:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541
2026-03-29 18:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e56f4e5-e247-56cf-a2b9-697d39dca00a with identifier: YF83541 to the API
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:55:31Z',
'fuel_type': 'diesel',
'id': '0e56f4e5-e247-56cf-a2b9-697d39dca00a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF83541',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 284890,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-09',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Saving data for YF83541: {'auction_closing_time': 1774886131.0, 'created_time': 1774521584.185089, 'last_price_update_time': 1774809621.053339}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF83541') HTTP/1.1" 204 0
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK25487%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Scrape type for BK25487: 0
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Scrape type for EA13854: 0
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Scrape type for KF98082: 2
2026-03-29 18:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-29 18:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762, identifier: KF98082
2026-03-29 18:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-29 18:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082
2026-03-29 18:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f162d6f-6e38-554d-b98e-c5a0cf2c9762 with identifier: KF98082 to the API
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:20:42Z',
'fuel_type': 'petrol',
'id': '1f162d6f-6e38-554d-b98e-c5a0cf2c9762',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF98082',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 73254,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-05',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2009}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Saving data for KF98082: {'auction_closing_time': 1774884042.0, 'created_time': 1774522152.056699, 'last_price_update_time': 1774809621.553442}
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF98082') HTTP/1.1" 204 0
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-29 18:40:21 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-29 18:40:21 [auto1.de] INFO: Scrape type for MH67551: 2
2026-03-29 18:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-29 18:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a775d95-122c-5cc6-afc1-2c51c9555770 with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a775d95-122c-5cc6-afc1-2c51c9555770 with scrape type 2
2026-03-29 18:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a775d95-122c-5cc6-afc1-2c51c9555770, identifier: MH67551
2026-03-29 18:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-29 18:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-29 18:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551 to the API
2026-03-29 18:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:42:56Z',
'fuel_type': 'diesel',
'id': '1a775d95-122c-5cc6-afc1-2c51c9555770',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH67551',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 145093,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-19',
'seller_name': None,
'title': 'Skoda Roomster 1.9 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2007}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Saving data for MH67551: {'auction_closing_time': 1774885376.0, 'created_time': 1774350356.484311, 'last_price_update_time': 1774809622.124715}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH67551') HTTP/1.1" 204 0
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Scrape type for SA94096: 2
2026-03-29 18:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-29 18:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a256c9-b188-5fcc-843a-e6b4896b9835 with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a256c9-b188-5fcc-843a-e6b4896b9835 with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4a256c9-b188-5fcc-843a-e6b4896b9835, identifier: SA94096
2026-03-29 18:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-29 18:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-29 18:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096 to the API
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:23:36Z',
'fuel_type': 'petrol',
'id': 'a4a256c9-b188-5fcc-843a-e6b4896b9835',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA94096',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 40963,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-31',
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2023}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Saving data for SA94096: {'auction_closing_time': 1774884216.0, 'created_time': 1773307114.572102, 'last_price_update_time': 1774809622.589119}
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA94096') HTTP/1.1" 204 0
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-29 18:40:22 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-29 18:40:22 [auto1.de] INFO: Scrape type for BK49064: 2
2026-03-29 18:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-29 18:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a1cb5c-a663-51f5-979a-ec8b11206b9d with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45a1cb5c-a663-51f5-979a-ec8b11206b9d with scrape type 2
2026-03-29 18:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45a1cb5c-a663-51f5-979a-ec8b11206b9d, identifier: BK49064
2026-03-29 18:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-29 18:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-29 18:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064 to the API
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:52:21Z',
'fuel_type': 'petrol',
'id': '45a1cb5c-a663-51f5-979a-ec8b11206b9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK49064',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 131467,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-19',
'seller_name': None,
'title': 'Volkswagen Beetle 1.4 TSI Design',
'transmission': 'manual',
'trim': 'Design',
'year': 2013}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Saving data for BK49064: {'auction_closing_time': 1774885941.0, 'created_time': 1773307747.900012, 'last_price_update_time': 1774809623.066002}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK49064') HTTP/1.1" 204 0
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA65377%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Scrape type for HA65377: 0
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Scrape type for AR72060: 2
2026-03-29 18:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-29 18:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8306150f-da16-5cd2-8527-3d2bfc7f92f4, identifier: AR72060
2026-03-29 18:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-29 18:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060
2026-03-29 18:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8306150f-da16-5cd2-8527-3d2bfc7f92f4 with identifier: AR72060 to the API
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:48:22Z',
'fuel_type': 'diesel',
'id': '8306150f-da16-5cd2-8527-3d2bfc7f92f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR72060',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 141659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-15',
'seller_name': None,
'title': 'BMW 2er 220d Gran Tourer Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2015}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Saving data for AR72060: {'auction_closing_time': 1774885702.0, 'created_time': 1774522108.18799, 'last_price_update_time': 1774809623.492219}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR72060') HTTP/1.1" 204 0
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Scrape type for BG36952: 0
2026-03-29 18:40:23 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-29 18:40:23 [auto1.de] INFO: Scrape type for WK78247: 2
2026-03-29 18:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-29 18:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58001774-0a17-5d02-93f9-e4958e8e2009 with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58001774-0a17-5d02-93f9-e4958e8e2009 with scrape type 2
2026-03-29 18:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58001774-0a17-5d02-93f9-e4958e8e2009, identifier: WK78247
2026-03-29 18:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-29 18:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-29 18:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247 to the API
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:26:28Z',
'fuel_type': 'petrol',
'id': '58001774-0a17-5d02-93f9-e4958e8e2009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK78247',
'listing': 'auction',
'make': 'Porsche',
'model': 'Panamera',
'odometer': 145009,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-30',
'seller_name': None,
'title': 'Porsche Panamera 3.6',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Saving data for WK78247: {'auction_closing_time': 1774884388.0, 'created_time': 1773775912.694358, 'last_price_update_time': 1774809624.001425}
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK78247') HTTP/1.1" 204 0
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Scrape type for XR06088: 2
2026-03-29 18:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-29 18:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a950c4cb-e475-5f41-a41a-cfc268e8ce08 with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a950c4cb-e475-5f41-a41a-cfc268e8ce08 with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a950c4cb-e475-5f41-a41a-cfc268e8ce08, identifier: XR06088
2026-03-29 18:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-29 18:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-29 18:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088 to the API
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:06:28Z',
'fuel_type': 'electro',
'id': 'a950c4cb-e475-5f41-a41a-cfc268e8ce08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR06088',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'ID.4',
'odometer': 93134,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-20',
'seller_name': None,
'title': 'Volkswagen ID.4 electric drive 150 kW Family Pro Performance',
'transmission': 'automatic',
'trim': 'Family Pro Performance',
'year': 2021}
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Saving data for XR06088: {'auction_closing_time': 1774883188.0, 'created_time': 1774330543.487411, 'last_price_update_time': 1774809624.566334}
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR06088') HTTP/1.1" 204 0
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-29 18:40:24 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-29 18:40:24 [auto1.de] INFO: Scrape type for NB80689: 2
2026-03-29 18:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-29 18:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e94735-3121-58c7-88ea-84870541eb6a with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e94735-3121-58c7-88ea-84870541eb6a with scrape type 2
2026-03-29 18:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3e94735-3121-58c7-88ea-84870541eb6a, identifier: NB80689
2026-03-29 18:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-29 18:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-29 18:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689 to the API
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:28:27Z',
'fuel_type': 'petrol',
'id': 'a3e94735-3121-58c7-88ea-84870541eb6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB80689',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 183366,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-10',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Saving data for NB80689: {'auction_closing_time': 1774884507.0, 'created_time': 1773775996.657466, 'last_price_update_time': 1774809625.038771}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB80689') HTTP/1.1" 204 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for RY74387: 2
2026-03-29 18:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-29 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f, identifier: RY74387
2026-03-29 18:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-29 18:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-29 18:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387 to the API
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:00:17Z',
'fuel_type': 'petrol',
'id': '89cefb2c-9a32-56da-9cb2-dec0ee44e74f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY74387',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 131453,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-12',
'seller_name': None,
'title': 'Skoda Yeti 1.4 TSI Adventure',
'transmission': 'automatic',
'trim': 'Adventure',
'year': 2014}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Saving data for RY74387: {'auction_closing_time': 1774882817.0, 'created_time': 1774608172.975299, 'last_price_update_time': 1774809625.480535}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY74387') HTTP/1.1" 204 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for LU05399: 2
2026-03-29 18:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-29 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4c8b30f-3e4e-5ee3-9431-89b2335b9551, identifier: LU05399
2026-03-29 18:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-29 18:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399
2026-03-29 18:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4c8b30f-3e4e-5ee3-9431-89b2335b9551 with identifier: LU05399 to the API
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:11:33Z',
'fuel_type': 'petrol',
'id': 'c4c8b30f-3e4e-5ee3-9431-89b2335b9551',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU05399',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 144678,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-02-08',
'seller_name': None,
'title': 'Renault Espace 2.0 Turbo Dynamique',
'transmission': 'automatic',
'trim': 'Dynamique',
'year': 2006}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Saving data for LU05399: {'auction_closing_time': 1774883493.0, 'created_time': 1774034620.095612, 'last_price_update_time': 1774809625.877272}
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU05399') HTTP/1.1" 204 0
2026-03-29 18:40:25 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-29 18:40:25 [auto1.de] INFO: Scrape type for CG37659: 2
2026-03-29 18:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-29 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded9a852-ba97-547d-8c7f-c0e9363d3a45 with scrape type 2
2026-03-29 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ded9a852-ba97-547d-8c7f-c0e9363d3a45 with scrape type 2
2026-03-29 18:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ded9a852-ba97-547d-8c7f-c0e9363d3a45, identifier: CG37659
2026-03-29 18:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-29 18:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-29 18:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659 to the API
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:04:28Z',
'fuel_type': 'diesel',
'id': 'ded9a852-ba97-547d-8c7f-c0e9363d3a45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG37659',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 127702,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-27',
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Saving data for CG37659: {'auction_closing_time': 1774883068.0, 'created_time': 1773380140.319742, 'last_price_update_time': 1774809626.355603}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG37659') HTTP/1.1" 204 0
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-29 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:26 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM12960%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Scrape type for ZM12960: 0
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-29 18:40:26 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Scrape type for NH13691: 2
2026-03-29 18:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-29 18:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with scrape type 2
2026-03-29 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with scrape type 2
2026-03-29 18:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9, identifier: NH13691
2026-03-29 18:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-29 18:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-29 18:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691 to the API
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:40:00Z',
'fuel_type': 'petrol',
'id': '34f648d1-f500-5c5b-8807-9ea32ce3ffd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH13691',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 105251,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-05',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-29 18:40:26 [auto1.de] INFO: Saving data for NH13691: {'auction_closing_time': 1774885200.0, 'created_time': 1773830144.010198, 'last_price_update_time': 1774809626.928823}
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH13691') HTTP/1.1" 204 0
2026-03-29 18:40:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for HU88385: 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for MG81975: 2
2026-03-29 18:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-29 18:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79f41c08-e1c8-54ef-820c-82ae5030fff1 with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79f41c08-e1c8-54ef-820c-82ae5030fff1 with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79f41c08-e1c8-54ef-820c-82ae5030fff1, identifier: MG81975
2026-03-29 18:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-29 18:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975
2026-03-29 18:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79f41c08-e1c8-54ef-820c-82ae5030fff1 with identifier: MG81975 to the API
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:38:40Z',
'fuel_type': 'petrol',
'id': '79f41c08-e1c8-54ef-820c-82ae5030fff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG81975',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 131228,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-06',
'seller_name': None,
'title': 'Mazda 3 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Saving data for MG81975: {'auction_closing_time': 1774885120.0, 'created_time': 1774522189.849585, 'last_price_update_time': 1774809627.433906}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG81975') HTTP/1.1" 204 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for BV10728: 2
2026-03-29 18:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-29 18:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba53aa0c-91b5-55de-8110-22e30ff94ffb with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba53aa0c-91b5-55de-8110-22e30ff94ffb with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba53aa0c-91b5-55de-8110-22e30ff94ffb, identifier: BV10728
2026-03-29 18:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-29 18:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-29 18:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728 to the API
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:17:26Z',
'fuel_type': 'diesel',
'id': 'ba53aa0c-91b5-55de-8110-22e30ff94ffb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV10728',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Kombi',
'odometer': 180868,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-12',
'seller_name': None,
'title': 'Volkswagen T5 Kombi 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Saving data for BV10728: {'auction_closing_time': 1774883846.0, 'created_time': 1774608138.995601, 'last_price_update_time': 1774809627.90088}
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV10728') HTTP/1.1" 204 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for HX49915: 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70837%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for DM70837: 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE50897%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for KE50897: 0
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-29 18:40:27 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-29 18:40:27 [auto1.de] INFO: Scrape type for BL07705: 2
2026-03-29 18:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-29 18:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with scrape type 2
2026-03-29 18:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with scrape type 2
2026-03-29 18:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9, identifier: BL07705
2026-03-29 18:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-29 18:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-29 18:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705 to the API
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:09:14Z',
'fuel_type': 'petrol',
'id': '65b8bc14-64fc-5809-ba5d-b99f1c3124b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL07705',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 211141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-22',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TFSI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Saving data for BL07705: {'auction_closing_time': 1774883354.0, 'created_time': 1773383434.873398, 'last_price_update_time': 1774809628.430509}
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL07705') HTTP/1.1" 204 0
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Scrape type for AM64478: 0
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-29 18:40:28 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-29 18:40:28 [auto1.de] INFO: Scrape type for TX92660: 2
2026-03-29 18:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-29 18:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeddfba2-250f-53ba-94e2-ab2cad133537 with scrape type 2
2026-03-29 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeddfba2-250f-53ba-94e2-ab2cad133537 with scrape type 2
2026-03-29 18:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeddfba2-250f-53ba-94e2-ab2cad133537, identifier: TX92660
2026-03-29 18:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-29 18:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-29 18:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660 to the API
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:56:33Z',
'fuel_type': 'diesel',
'id': 'aeddfba2-250f-53ba-94e2-ab2cad133537',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX92660',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 187595,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-06',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'manual',
'trim': 'Sport & Style 4Motion',
'year': 2009}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Saving data for TX92660: {'auction_closing_time': 1774886193.0, 'created_time': 1773302854.033142, 'last_price_update_time': 1774809629.061786}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX92660') HTTP/1.1" 204 0
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Scrape type for RP72323: 2
2026-03-29 18:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-29 18:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a6804a-4c22-514c-9e80-c2d2723e112b with scrape type 2
2026-03-29 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a6804a-4c22-514c-9e80-c2d2723e112b with scrape type 2
2026-03-29 18:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a6804a-4c22-514c-9e80-c2d2723e112b, identifier: RP72323
2026-03-29 18:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-29 18:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-29 18:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323 to the API
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:58:46Z',
'fuel_type': 'diesel',
'id': 'd2a6804a-4c22-514c-9e80-c2d2723e112b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP72323',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 217250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-24',
'seller_name': None,
'title': 'BMW 3er 320d xDrive Advantage',
'transmission': 'automatic',
'trim': 'xDrive Advantage',
'year': 2015}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Saving data for RP72323: {'auction_closing_time': 1774886326.0, 'created_time': 1773401592.100677, 'last_price_update_time': 1774809629.585573}
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP72323') HTTP/1.1" 204 0
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-29 18:40:29 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-29 18:40:29 [auto1.de] INFO: Scrape type for CF85526: 2
2026-03-29 18:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526
2026-03-29 18:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7bc35b9-6828-580e-940b-ad3dc78296cb with scrape type 2
2026-03-29 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7bc35b9-6828-580e-940b-ad3dc78296cb with scrape type 2
2026-03-29 18:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7bc35b9-6828-580e-940b-ad3dc78296cb, identifier: CF85526
2026-03-29 18:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526
2026-03-29 18:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526
2026-03-29 18:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7bc35b9-6828-580e-940b-ad3dc78296cb with identifier: CF85526 to the API
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:09:10Z',
'fuel_type': 'petrol',
'id': 'a7bc35b9-6828-580e-940b-ad3dc78296cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF85526',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 106802,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-10',
'seller_name': None,
'title': 'Audi Q5 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-29 18:40:30 [auto1.de] INFO: Saving data for CF85526: {'auction_closing_time': 1774883350.0, 'created_time': 1773227566.121359, 'last_price_update_time': 1774809630.021237}
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF85526') HTTP/1.1" 204 0
2026-03-29 18:40:30 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-29 18:40:30 [auto1.de] INFO: Scrape type for GX91022: 0
2026-03-29 18:40:30 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-29 18:40:30 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-29 18:40:30 [auto1.de] INFO: Scrape type for YJ19270: 2
2026-03-29 18:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-29 18:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with scrape type 2
2026-03-29 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with scrape type 2
2026-03-29 18:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128, identifier: YJ19270
2026-03-29 18:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-29 18:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-29 18:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270 to the API
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:47Z',
'fuel_type': 'petrol',
'id': '6b2259c8-ff4b-5bb2-982d-b1d787e7c128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ19270',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 69432,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-04',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-29 18:40:30 [auto1.de] INFO: Saving data for YJ19270: {'auction_closing_time': 1774886267.0, 'created_time': 1773861661.218184, 'last_price_update_time': 1774809630.533591}
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ19270') HTTP/1.1" 204 0
2026-03-29 18:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:30 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-29 18:40:30 [auto1.de] INFO: Scrape type for UA56207: 2
2026-03-29 18:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-29 18:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with scrape type 2
2026-03-29 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with scrape type 2
2026-03-29 18:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f060cc35-4113-5f3f-9eb8-57f7ad02ea75, identifier: UA56207
2026-03-29 18:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-29 18:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207
2026-03-29 18:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f060cc35-4113-5f3f-9eb8-57f7ad02ea75 with identifier: UA56207 to the API
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:47:47Z',
'fuel_type': 'diesel',
'id': 'f060cc35-4113-5f3f-9eb8-57f7ad02ea75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA56207',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 38847,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-19',
'seller_name': None,
'title': 'Ford Transit 1.5 TDCi Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 2018}
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-29 18:40:30 [auto1.de] INFO: Saving data for UA56207: {'auction_closing_time': 1774885667.0, 'created_time': 1773345212.34461, 'last_price_update_time': 1774809630.951721}
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA56207') HTTP/1.1" 204 0
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Scrape type for KL79607: 2
2026-03-29 18:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-29 18:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b with scrape type 2
2026-03-29 18:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b with scrape type 2
2026-03-29 18:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4cc6305-3dc3-5963-9880-cd5df1c48e9b, identifier: KL79607
2026-03-29 18:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-29 18:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-29 18:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607 to the API
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:01:26Z',
'fuel_type': 'petrol',
'id': 'c4cc6305-3dc3-5963-9880-cd5df1c48e9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL79607',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 187897,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-12-31',
'seller_name': None,
'title': 'Opel Astra 1.8 Bild Alternativ',
'transmission': 'automatic',
'trim': 'Bild Alternativ',
'year': 2000}
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Saving data for KL79607: {'auction_closing_time': 1774882886.0, 'created_time': 1774608260.129506, 'last_price_update_time': 1774809631.834277}
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL79607') HTTP/1.1" 204 0
2026-03-29 18:40:31 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Scrape type for YL76472: 0
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-29 18:40:31 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-29 18:40:31 [auto1.de] INFO: Scrape type for HG88982: 2
2026-03-29 18:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982
2026-03-29 18:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525f407c-e6f0-5e8d-b628-1e1b00077b2b with scrape type 2
2026-03-29 18:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 525f407c-e6f0-5e8d-b628-1e1b00077b2b with scrape type 2
2026-03-29 18:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 525f407c-e6f0-5e8d-b628-1e1b00077b2b, identifier: HG88982
2026-03-29 18:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982
2026-03-29 18:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982
2026-03-29 18:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 525f407c-e6f0-5e8d-b628-1e1b00077b2b with identifier: HG88982 to the API
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:32:25Z',
'fuel_type': 'diesel',
'id': '525f407c-e6f0-5e8d-b628-1e1b00077b2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG88982',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 207271,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-03',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline 4Motion BlueMotion',
'year': 2015}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Saving data for HG88982: {'auction_closing_time': 1774884745.0, 'created_time': 1773229937.87208, 'last_price_update_time': 1774809632.303976}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG88982') HTTP/1.1" 204 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for ED43113: 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for BW09320: 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13980%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for EP13980: 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP19513%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for GP19513: 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE37083%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for DE37083: 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for VB96558: 2
2026-03-29 18:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-29 18:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449f08bb-ac24-543d-8dbe-c0b409c9a547 with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 449f08bb-ac24-543d-8dbe-c0b409c9a547 with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 449f08bb-ac24-543d-8dbe-c0b409c9a547, identifier: VB96558
2026-03-29 18:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-29 18:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-29 18:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-29 18:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558 to the API
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:00Z',
'fuel_type': 'diesel',
'id': '449f08bb-ac24-543d-8dbe-c0b409c9a547',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB96558',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 153124,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-14',
'seller_name': None,
'title': 'Skoda Karoq 2.0 TDI Style 4x4',
'transmission': 'automatic',
'trim': 'Style 4x4',
'year': 2017}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Saving data for VB96558: {'auction_closing_time': 1774885440.0, 'created_time': 1773307711.84879, 'last_price_update_time': 1774809632.858628}
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB96558') HTTP/1.1" 204 0
2026-03-29 18:40:32 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-29 18:40:32 [auto1.de] INFO: Scrape type for DG34308: 2
2026-03-29 18:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-29 18:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with scrape type 2
2026-03-29 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with scrape type 2
2026-03-29 18:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce, identifier: DG34308
2026-03-29 18:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-29 18:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-29 18:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308 to the API
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:51:17Z',
'fuel_type': 'petrol',
'id': '6c8f0679-13f1-5bcc-a465-ab1c7e62cdce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG34308',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 162669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-05',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Saving data for DG34308: {'auction_closing_time': 1774885877.0, 'created_time': 1773303193.409721, 'last_price_update_time': 1774809633.404005}
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG34308') HTTP/1.1" 204 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM13407%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for SM13407: 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for KZ71348: 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE22331%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for DE22331: 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP54397%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for GP54397: 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96543%27 HTTP/1.1" 200 None
2026-03-29 18:40:33 [auto1.de] INFO: Scrape type for XZ96543: 0
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-29 18:40:33 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-29 18:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:34 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: US78573
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-29 18:40:34 [auto1.de] INFO: Scrape type for US78573: 0
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-29 18:40:34 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-29 18:40:34 [auto1.de] INFO: Scrape type for TR13409: 2
2026-03-29 18:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409
2026-03-29 18:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a88b5f00-afc0-5f02-92ca-29d6080430e2 with scrape type 2
2026-03-29 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a88b5f00-afc0-5f02-92ca-29d6080430e2 with scrape type 2
2026-03-29 18:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a88b5f00-afc0-5f02-92ca-29d6080430e2, identifier: TR13409
2026-03-29 18:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409
2026-03-29 18:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409
2026-03-29 18:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a88b5f00-afc0-5f02-92ca-29d6080430e2 with identifier: TR13409 to the API
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:07:39Z',
'fuel_type': 'diesel',
'id': 'a88b5f00-afc0-5f02-92ca-29d6080430e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR13409',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 127899,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-07',
'seller_name': None,
'title': 'Audi A4 2.0 TDI S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'S line Sportpaket plus',
'year': 2013}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Saving data for TR13409: {'auction_closing_time': 1774883259.0, 'created_time': 1773946547.883605, 'last_price_update_time': 1774809635.016362}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR13409') HTTP/1.1" 204 0
2026-03-29 18:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93445%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Scrape type for NL93445: 0
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Scrape type for CA38480: 2
2026-03-29 18:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-29 18:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac, identifier: CA38480
2026-03-29 18:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-29 18:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-29 18:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480 to the API
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:36:22Z',
'fuel_type': 'petrol',
'id': '1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA38480',
'listing': 'auction',
'make': 'BMW',
'model': 'Z4',
'odometer': 124018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-05',
'seller_name': None,
'title': 'BMW Z4 sDrive 30i',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Saving data for CA38480: {'auction_closing_time': 1774884982.0, 'created_time': 1773686206.157547, 'last_price_update_time': 1774809635.55205}
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA38480') HTTP/1.1" 204 0
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK62428%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Scrape type for VK62428: 0
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-29 18:40:35 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-29 18:40:35 [auto1.de] INFO: Scrape type for ZS55646: 2
2026-03-29 18:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646
2026-03-29 18:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6319a2-bad8-56d7-837d-e184347807c0 with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d6319a2-bad8-56d7-837d-e184347807c0 with scrape type 2
2026-03-29 18:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d6319a2-bad8-56d7-837d-e184347807c0, identifier: ZS55646
2026-03-29 18:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646
2026-03-29 18:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646
2026-03-29 18:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d6319a2-bad8-56d7-837d-e184347807c0 with identifier: ZS55646 to the API
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:32:21Z',
'fuel_type': 'diesel',
'id': '6d6319a2-bad8-56d7-837d-e184347807c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS55646',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 322535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-29',
'seller_name': None,
'title': 'BMW 3er 320d EfficientDynamics Edition',
'transmission': 'manual',
'trim': 'EfficientDynamics Edition',
'year': 2012}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Saving data for ZS55646: {'auction_closing_time': 1774884741.0, 'created_time': 1774350253.45486, 'last_price_update_time': 1774809636.009932}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS55646') HTTP/1.1" 204 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD70157%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for MD70157: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT32036%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for UT32036: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for UF88550: 2
2026-03-29 18:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-29 18:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc428fd-cfba-5e75-b43c-c0704bde8799 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afc428fd-cfba-5e75-b43c-c0704bde8799 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afc428fd-cfba-5e75-b43c-c0704bde8799, identifier: UF88550
2026-03-29 18:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-29 18:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-29 18:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550 to the API
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:13:54Z',
'fuel_type': 'diesel',
'id': 'afc428fd-cfba-5e75-b43c-c0704bde8799',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF88550',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 267188,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-17',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Saving data for UF88550: {'auction_closing_time': 1774883634.0, 'created_time': 1773830357.863718, 'last_price_update_time': 1774809636.509599}
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF88550') HTTP/1.1" 204 0
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-29 18:40:36 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-29 18:40:36 [auto1.de] INFO: Scrape type for KH20562: 2
2026-03-29 18:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-29 18:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22452bb-7a4a-5b55-90c2-e7e48a451095 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e22452bb-7a4a-5b55-90c2-e7e48a451095 with scrape type 2
2026-03-29 18:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e22452bb-7a4a-5b55-90c2-e7e48a451095, identifier: KH20562
2026-03-29 18:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-29 18:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-29 18:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562 to the API
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:41:18Z',
'fuel_type': 'petrol',
'id': 'e22452bb-7a4a-5b55-90c2-e7e48a451095',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH20562',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 107445,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-25',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CGI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Saving data for KH20562: {'auction_closing_time': 1774885278.0, 'created_time': 1773341572.003589, 'last_price_update_time': 1774809637.145784}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH20562') HTTP/1.1" 204 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for JJ90967: 2
2026-03-29 18:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-29 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef26d279-a85b-5aa6-bdc1-faff4f306f50 with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef26d279-a85b-5aa6-bdc1-faff4f306f50 with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef26d279-a85b-5aa6-bdc1-faff4f306f50, identifier: JJ90967
2026-03-29 18:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-29 18:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967
2026-03-29 18:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef26d279-a85b-5aa6-bdc1-faff4f306f50 with identifier: JJ90967 to the API
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:15Z',
'fuel_type': 'petrol',
'id': 'ef26d279-a85b-5aa6-bdc1-faff4f306f50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ90967',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 188785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seller_name': None,
'title': 'Audi Q2 1.4 TFSI ACT Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2017}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Saving data for JJ90967: {'auction_closing_time': 1774883775.0, 'created_time': 1774522143.059001, 'last_price_update_time': 1774809637.584399}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ90967') HTTP/1.1" 204 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for ND67175: 0
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-29 18:40:37 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-29 18:40:37 [auto1.de] INFO: Scrape type for FG01299: 2
2026-03-29 18:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-29 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce51b7c8-365b-5bca-87a3-d6997ee936df with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce51b7c8-365b-5bca-87a3-d6997ee936df with scrape type 2
2026-03-29 18:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce51b7c8-365b-5bca-87a3-d6997ee936df, identifier: FG01299
2026-03-29 18:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-29 18:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299
2026-03-29 18:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce51b7c8-365b-5bca-87a3-d6997ee936df with identifier: FG01299 to the API
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:44:59Z',
'fuel_type': 'petrol',
'id': 'ce51b7c8-365b-5bca-87a3-d6997ee936df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG01299',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 197731,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-29',
'seller_name': None,
'title': 'Seat Ibiza 1.6 Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2009}
2026-03-29 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Saving data for FG01299: {'auction_closing_time': 1774885499.0, 'created_time': 1774522140.954486, 'last_price_update_time': 1774809638.005582}
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG01299') HTTP/1.1" 204 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for XD50788: 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for WX30438: 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for ED91782: 2
2026-03-29 18:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-29 18:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0295c5d7-fb95-550a-847b-28b21e0b69a1 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0295c5d7-fb95-550a-847b-28b21e0b69a1 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0295c5d7-fb95-550a-847b-28b21e0b69a1, identifier: ED91782
2026-03-29 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-29 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782
2026-03-29 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0295c5d7-fb95-550a-847b-28b21e0b69a1 with identifier: ED91782 to the API
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:11Z',
'fuel_type': 'petrol',
'id': '0295c5d7-fb95-550a-847b-28b21e0b69a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED91782',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 121759,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-20',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI ACT Trendline 4Motion BlueMotion',
'transmission': 'manual',
'trim': 'Trendline 4Motion BlueMotion',
'year': 2017}
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Saving data for ED91782: {'auction_closing_time': 1774884251.0, 'created_time': 1774522265.655727, 'last_price_update_time': 1774809638.470232}
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED91782') HTTP/1.1" 204 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-29 18:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:38 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE71372%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for FE71372: 0
2026-03-29 18:40:38 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-29 18:40:38 [auto1.de] INFO: Scrape type for SS51493: 2
2026-03-29 18:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493
2026-03-29 18:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fec73bf8-70b3-5287-93d5-5d1cecc98043 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fec73bf8-70b3-5287-93d5-5d1cecc98043 with scrape type 2
2026-03-29 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fec73bf8-70b3-5287-93d5-5d1cecc98043, identifier: SS51493
2026-03-29 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493
2026-03-29 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493
2026-03-29 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493 to the API
2026-03-29 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:58:30Z',
'fuel_type': 'petrol',
'id': 'fec73bf8-70b3-5287-93d5-5d1cecc98043',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS51493',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 172944,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-06',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Saving data for SS51493: {'auction_closing_time': 1774886310.0, 'created_time': 1773225544.729036, 'last_price_update_time': 1774809639.151575}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS51493') HTTP/1.1" 204 0
2026-03-29 18:40:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ04828%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for HJ04828: 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for WD73510: 2
2026-03-29 18:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510
2026-03-29 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa54f4c-493d-586d-a2b2-24e95d5f486f with scrape type 2
2026-03-29 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afa54f4c-493d-586d-a2b2-24e95d5f486f with scrape type 2
2026-03-29 18:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afa54f4c-493d-586d-a2b2-24e95d5f486f, identifier: WD73510
2026-03-29 18:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510
2026-03-29 18:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510
2026-03-29 18:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afa54f4c-493d-586d-a2b2-24e95d5f486f with identifier: WD73510 to the API
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:00:01Z',
'fuel_type': 'petrol',
'id': 'afa54f4c-493d-586d-a2b2-24e95d5f486f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD73510',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 28231,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-26',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2015}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Saving data for WD73510: {'auction_closing_time': 1774882801.0, 'created_time': 1773466533.201349, 'last_price_update_time': 1774809639.576517}
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD73510') HTTP/1.1" 204 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56526%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for KU56526: 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN05925%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for ZN05925: 0
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-29 18:40:39 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-29 18:40:39 [auto1.de] INFO: Scrape type for JJ29192: 2
2026-03-29 18:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-29 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with scrape type 2
2026-03-29 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with scrape type 2
2026-03-29 18:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd, identifier: JJ29192
2026-03-29 18:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-29 18:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192
2026-03-29 18:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd with identifier: JJ29192 to the API
2026-03-29 18:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:41:19Z',
'fuel_type': 'petrol',
'id': '8bc26a3e-c1bb-5ec5-a6aa-b0de9d4474fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ29192',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 186438,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-09',
'seller_name': None,
'title': 'BMW 1er 116i Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2008}
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Saving data for JJ29192: {'auction_closing_time': 1774885279.0, 'created_time': 1773382596.543345, 'last_price_update_time': 1774809640.111751}
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ29192') HTTP/1.1" 204 0
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH25486%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for PH25486: 0
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for WX13584: 2
2026-03-29 18:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-29 18:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with scrape type 2
2026-03-29 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with scrape type 2
2026-03-29 18:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e93d99ec-6416-560c-8d3d-f92d0d7a68b5, identifier: WX13584
2026-03-29 18:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-29 18:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-29 18:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584 to the API
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:16:47Z',
'fuel_type': 'petrol',
'id': 'e93d99ec-6416-560c-8d3d-f92d0d7a68b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX13584',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 49057,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seller_name': None,
'title': 'Fiat 500 0.9 S',
'transmission': 'manual',
'trim': 'S',
'year': 2018}
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Saving data for WX13584: {'auction_closing_time': 1774883807.0, 'created_time': 1774292306.281234, 'last_price_update_time': 1774809640.584134}
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX13584') HTTP/1.1" 204 0
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY00431%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for EY00431: 0
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY60596%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for HY60596: 0
2026-03-29 18:40:40 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-29 18:40:40 [auto1.de] INFO: Scrape type for PB35846: 2
2026-03-29 18:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-29 18:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with scrape type 2
2026-03-29 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with scrape type 2
2026-03-29 18:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a, identifier: PB35846
2026-03-29 18:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-29 18:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-29 18:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846 to the API
2026-03-29 18:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:56:24Z',
'fuel_type': 'petrol',
'id': '8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB35846',
'listing': 'auction',
'make': 'Seat',
'model': 'Mii',
'odometer': 104798,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-27',
'seller_name': None,
'title': 'Seat Mii 1.0 FR-Line',
'transmission': 'manual',
'trim': 'FR-Line',
'year': 2016}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Saving data for PB35846: {'auction_closing_time': 1774886184.0, 'created_time': 1774607868.888461, 'last_price_update_time': 1774809641.11841}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB35846') HTTP/1.1" 204 0
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Scrape type for RZ14311: 2
2026-03-29 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-29 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca3d5718-933b-5fe6-9bc3-2b748e4b0093, identifier: RZ14311
2026-03-29 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-29 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311
2026-03-29 18:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca3d5718-933b-5fe6-9bc3-2b748e4b0093 with identifier: RZ14311 to the API
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:51:53Z',
'fuel_type': 'diesel',
'id': 'ca3d5718-933b-5fe6-9bc3-2b748e4b0093',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ14311',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Kombi',
'odometer': 484880,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-18',
'seller_name': None,
'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2015}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Saving data for RZ14311: {'auction_closing_time': 1774885913.0, 'created_time': 1773224131.491213, 'last_price_update_time': 1774809641.665869}
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ14311') HTTP/1.1" 204 0
2026-03-29 18:40:41 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-29 18:40:41 [auto1.de] INFO: Scrape type for YS55163: 2
2026-03-29 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-29 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59314d11-3d3a-53a2-873c-52c843a5a3d7 with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59314d11-3d3a-53a2-873c-52c843a5a3d7 with scrape type 2
2026-03-29 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59314d11-3d3a-53a2-873c-52c843a5a3d7, identifier: YS55163
2026-03-29 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-29 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-29 18:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163 to the API
2026-03-29 18:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:58:28Z',
'fuel_type': 'petrol',
'id': '59314d11-3d3a-53a2-873c-52c843a5a3d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS55163',
'listing': 'auction',
'make': 'Dacia',
'model': 'Jogger',
'odometer': 41237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-25',
'seller_name': None,
'title': 'Dacia Jogger 1.0 TCe Extreme+',
'transmission': 'manual',
'trim': 'Extreme+',
'year': 2023}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Saving data for YS55163: {'auction_closing_time': 1774886308.0, 'created_time': 1773946868.913418, 'last_price_update_time': 1774809642.151183}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS55163') HTTP/1.1" 204 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for HB08106: 2
2026-03-29 18:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-29 18:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704, identifier: HB08106
2026-03-29 18:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-29 18:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-29 18:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106 to the API
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:45:46Z',
'fuel_type': 'petrol',
'id': '5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB08106',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 43854,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-15',
'seller_name': None,
'title': 'BMW 1er 128ti',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Saving data for HB08106: {'auction_closing_time': 1774885546.0, 'created_time': 1774291074.517515, 'last_price_update_time': 1774809642.624954}
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB08106') HTTP/1.1" 204 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40216%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for ZU40216: 0
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-29 18:40:42 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-29 18:40:42 [auto1.de] INFO: Scrape type for MK68330: 2
2026-03-29 18:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-29 18:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48973bba-4eb7-5792-ac31-d9317f2b05dc with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48973bba-4eb7-5792-ac31-d9317f2b05dc with scrape type 2
2026-03-29 18:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48973bba-4eb7-5792-ac31-d9317f2b05dc, identifier: MK68330
2026-03-29 18:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-29 18:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-29 18:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330 to the API
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:55:33Z',
'fuel_type': 'petrol',
'id': '48973bba-4eb7-5792-ac31-d9317f2b05dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK68330',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 32237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-30',
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2019}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Saving data for MK68330: {'auction_closing_time': 1774886133.0, 'created_time': 1773305686.473593, 'last_price_update_time': 1774809643.097714}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK68330') HTTP/1.1" 204 0
2026-03-29 18:40:43 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Scrape type for BM76815: 2
2026-03-29 18:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-29 18:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e186861a-a067-5e46-8066-0a3c3b6c158d with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e186861a-a067-5e46-8066-0a3c3b6c158d with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e186861a-a067-5e46-8066-0a3c3b6c158d, identifier: BM76815
2026-03-29 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-29 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-29 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815 to the API
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:16:21Z',
'fuel_type': 'diesel',
'id': 'e186861a-a067-5e46-8066-0a3c3b6c158d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM76815',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 227357,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-26',
'seller_name': None,
'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Saving data for BM76815: {'auction_closing_time': 1774883781.0, 'created_time': 1773860126.575271, 'last_price_update_time': 1774809643.541752}
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM76815') HTTP/1.1" 204 0
2026-03-29 18:40:43 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-29 18:40:43 [auto1.de] INFO: Scrape type for DM70862: 2
2026-03-29 18:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-29 18:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5fed20-9456-582a-948a-5c9ca0672fbd with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5fed20-9456-582a-948a-5c9ca0672fbd with scrape type 2
2026-03-29 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5fed20-9456-582a-948a-5c9ca0672fbd, identifier: DM70862
2026-03-29 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-29 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-29 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862 to the API
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:53:37Z',
'fuel_type': 'diesel',
'id': '5d5fed20-9456-582a-948a-5c9ca0672fbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM70862',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 22332,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2023}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Saving data for DM70862: {'auction_closing_time': 1774886017.0, 'created_time': 1773861787.746374, 'last_price_update_time': 1774809644.026347}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM70862') HTTP/1.1" 204 0
2026-03-29 18:40:44 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for JD23896: 2
2026-03-29 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-29 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea31509-2755-54ef-b527-7af6b42eddcc with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ea31509-2755-54ef-b527-7af6b42eddcc with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ea31509-2755-54ef-b527-7af6b42eddcc, identifier: JD23896
2026-03-29 18:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-29 18:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-29 18:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896 to the API
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:24Z',
'fuel_type': 'petrol',
'id': '4ea31509-2755-54ef-b527-7af6b42eddcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD23896',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 76174,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-08',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Trend & Fun BlueMotion Tech',
'year': 2016}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Saving data for JD23896: {'auction_closing_time': 1774883064.0, 'created_time': 1774607776.288624, 'last_price_update_time': 1774809644.5217}
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD23896') HTTP/1.1" 204 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV08426%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for UV08426: 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV10952%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for WV10952: 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for ZN40502: 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for VD78060: 2
2026-03-29 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-29 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ed6daa-f18b-5a89-9a7f-552adeed03ea with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ed6daa-f18b-5a89-9a7f-552adeed03ea with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85ed6daa-f18b-5a89-9a7f-552adeed03ea, identifier: VD78060
2026-03-29 18:40:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:44 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-29 18:40:44 [auto1.de] INFO: Scrape type for VE61397: 2
2026-03-29 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-29 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef57936-0030-5867-9342-add26f09c19f with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ef57936-0030-5867-9342-add26f09c19f with scrape type 2
2026-03-29 18:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ef57936-0030-5867-9342-add26f09c19f, identifier: VE61397
2026-03-29 18:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-29 18:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-29 18:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060 to the API
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:08:24Z',
'fuel_type': 'petrol',
'id': '85ed6daa-f18b-5a89-9a7f-552adeed03ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD78060',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 119111,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-31',
'seller_name': None,
'title': 'Renault Twingo 1.2 Authentique',
'transmission': 'manual',
'trim': 'Authentique',
'year': 2009}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Saving data for VD78060: {'auction_closing_time': 1774883304.0, 'created_time': 1774608651.713168, 'last_price_update_time': 1774809645.293078}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD78060') HTTP/1.1" 204 0
2026-03-29 18:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-29 18:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-29 18:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397 to the API
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:59:19Z',
'fuel_type': 'petrol',
'id': '9ef57936-0030-5867-9342-add26f09c19f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE61397',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 64126,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2021}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Saving data for VE61397: {'auction_closing_time': 1774886359.0, 'created_time': 1774608692.028047, 'last_price_update_time': 1774809645.753505}
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE61397') HTTP/1.1" 204 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW04069%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for RW04069: 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51107%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for SS51107: 0
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for ZZ43768: 2
2026-03-29 18:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-29 18:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c2be28d-d61f-58a1-8f16-7034c7136e3d with scrape type 2
2026-03-29 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c2be28d-d61f-58a1-8f16-7034c7136e3d with scrape type 2
2026-03-29 18:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c2be28d-d61f-58a1-8f16-7034c7136e3d, identifier: ZZ43768
2026-03-29 18:40:45 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-29 18:40:45 [auto1.de] INFO: Scrape type for GW97412: 2
2026-03-29 18:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412
2026-03-29 18:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bb45f3f-ad9d-51e6-a619-fd514554a051 with scrape type 2
2026-03-29 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bb45f3f-ad9d-51e6-a619-fd514554a051 with scrape type 2
2026-03-29 18:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bb45f3f-ad9d-51e6-a619-fd514554a051, identifier: GW97412
2026-03-29 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-29 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-29 18:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768 to the API
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:04:05Z',
'fuel_type': 'diesel',
'id': '1c2be28d-d61f-58a1-8f16-7034c7136e3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ43768',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 245269,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-30',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2014}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Saving data for ZZ43768: {'auction_closing_time': 1774883045.0, 'created_time': 1773342872.518771, 'last_price_update_time': 1774809646.398614}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ43768') HTTP/1.1" 204 0
2026-03-29 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412
2026-03-29 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412
2026-03-29 18:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bb45f3f-ad9d-51e6-a619-fd514554a051 with identifier: GW97412 to the API
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:46Z',
'fuel_type': 'petrol',
'id': '7bb45f3f-ad9d-51e6-a619-fd514554a051',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW97412',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 70537,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-18',
'seller_name': None,
'title': 'Volkswagen Golf VIII 1.5 TSI ACT Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2021}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Saving data for GW97412: {'auction_closing_time': 1774885006.0, 'created_time': 1773134754.157556, 'last_price_update_time': 1774809646.724424}
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW97412') HTTP/1.1" 204 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS04042%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for CS04042: 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH89031%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for FH89031: 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for YG21382: 2
2026-03-29 18:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-29 18:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with scrape type 2
2026-03-29 18:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with scrape type 2
2026-03-29 18:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765, identifier: YG21382
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA54240%27 HTTP/1.1" 200 None
2026-03-29 18:40:46 [auto1.de] INFO: Scrape type for CA54240: 0
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-29 18:40:46 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-29 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-29 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-29 18:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382 to the API
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:28:09Z',
'fuel_type': 'petrol',
'id': '400fa082-25ab-5be2-b8ec-8ee3cb9ba765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG21382',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 69089,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-08',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TSI RS 245',
'transmission': 'automatic',
'trim': 'RS 245',
'year': 2020}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Saving data for YG21382: {'auction_closing_time': 1774884489.0, 'created_time': 1772726265.993264, 'last_price_update_time': 1774809647.236239}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG21382') HTTP/1.1" 204 0
2026-03-29 18:40:47 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Scrape type for YU03537: 2
2026-03-29 18:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-29 18:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 747ae73a-61b7-58de-b89c-2d8d5ea910c3, identifier: YU03537
2026-03-29 18:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-29 18:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-29 18:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537 to the API
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:58:22Z',
'fuel_type': 'hybrid',
'id': '747ae73a-61b7-58de-b89c-2d8d5ea910c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU03537',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 99222,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-16',
'seller_name': None,
'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
'transmission': 'automatic',
'trim': 'VZ',
'year': 2022}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Saving data for YU03537: {'auction_closing_time': 1774886302.0, 'created_time': 1774607779.146964, 'last_price_update_time': 1774809647.788526}
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU03537') HTTP/1.1" 204 0
2026-03-29 18:40:47 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-29 18:40:47 [auto1.de] INFO: Scrape type for JE48122: 2
2026-03-29 18:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-29 18:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49de4338-c687-5252-8e6e-de7ca7a210f4 with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49de4338-c687-5252-8e6e-de7ca7a210f4 with scrape type 2
2026-03-29 18:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49de4338-c687-5252-8e6e-de7ca7a210f4, identifier: JE48122
2026-03-29 18:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-29 18:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-29 18:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122 to the API
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 355,
'expiration_date': '2026-03-30T15:34:18Z',
'fuel_type': 'petrol',
'id': '49de4338-c687-5252-8e6e-de7ca7a210f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE48122',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 120901,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-11',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2018}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Saving data for JE48122: {'auction_closing_time': 1774884858.0, 'created_time': 1773858956.559618, 'last_price_update_time': 1774809648.238571}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE48122') HTTP/1.1" 204 0
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Scrape type for LW69749: 2
2026-03-29 18:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749
2026-03-29 18:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b69b1ed9-2bac-5178-bc91-933aa9cde670 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b69b1ed9-2bac-5178-bc91-933aa9cde670 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b69b1ed9-2bac-5178-bc91-933aa9cde670, identifier: LW69749
2026-03-29 18:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749
2026-03-29 18:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749
2026-03-29 18:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b69b1ed9-2bac-5178-bc91-933aa9cde670 with identifier: LW69749 to the API
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:49:09Z',
'fuel_type': 'diesel',
'id': 'b69b1ed9-2bac-5178-bc91-933aa9cde670',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW69749',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 122743,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-22',
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Saving data for LW69749: {'auction_closing_time': 1774885749.0, 'created_time': 1774350634.114974, 'last_price_update_time': 1774809648.651446}
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW69749') HTTP/1.1" 204 0
2026-03-29 18:40:48 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-29 18:40:48 [auto1.de] INFO: Scrape type for SC19815: 2
2026-03-29 18:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-29 18:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d302ed0-f97e-5724-b442-502b501d15a4 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d302ed0-f97e-5724-b442-502b501d15a4 with scrape type 2
2026-03-29 18:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d302ed0-f97e-5724-b442-502b501d15a4, identifier: SC19815
2026-03-29 18:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-29 18:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-29 18:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815 to the API
2026-03-29 18:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:46:04Z',
'fuel_type': 'petrol',
'id': '1d302ed0-f97e-5724-b442-502b501d15a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC19815',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 49132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-15',
'seller_name': None,
'title': 'Opel Mokka X 1.4 Turbo Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2019}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Saving data for SC19815: {'auction_closing_time': 1774885564.0, 'created_time': 1773689006.285639, 'last_price_update_time': 1774809649.134591}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC19815') HTTP/1.1" 204 0
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Scrape type for DJ77655: 2
2026-03-29 18:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-29 18:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7e69ea0-969a-5b3a-b99f-7c04949eec5a with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7e69ea0-969a-5b3a-b99f-7c04949eec5a with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7e69ea0-969a-5b3a-b99f-7c04949eec5a, identifier: DJ77655
2026-03-29 18:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-29 18:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-29 18:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655 to the API
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:55:58Z',
'fuel_type': 'petrol',
'id': 'c7e69ea0-969a-5b3a-b99f-7c04949eec5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ77655',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 141354,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-14',
'seller_name': None,
'title': 'BMW X5 xDrive 50i',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Saving data for DJ77655: {'auction_closing_time': 1774886158.0, 'created_time': 1774294487.95957, 'last_price_update_time': 1774809649.601486}
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ77655') HTTP/1.1" 204 0
2026-03-29 18:40:49 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-29 18:40:49 [auto1.de] INFO: Scrape type for ZK43120: 2
2026-03-29 18:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120
2026-03-29 18:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13eaeea-2787-5935-a3ce-e38859fb0902 with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13eaeea-2787-5935-a3ce-e38859fb0902 with scrape type 2
2026-03-29 18:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c13eaeea-2787-5935-a3ce-e38859fb0902, identifier: ZK43120
2026-03-29 18:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120
2026-03-29 18:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120
2026-03-29 18:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c13eaeea-2787-5935-a3ce-e38859fb0902 with identifier: ZK43120 to the API
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:14:26Z',
'fuel_type': 'diesel',
'id': 'c13eaeea-2787-5935-a3ce-e38859fb0902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK43120',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 186821,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-23',
'seller_name': None,
'title': 'Mercedes-Benz Vito 111 CDI Lang',
'transmission': 'manual',
'trim': 'Lang',
'year': 2007}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Saving data for ZK43120: {'auction_closing_time': 1774883666.0, 'created_time': 1773947073.680524, 'last_price_update_time': 1774809650.017188}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK43120') HTTP/1.1" 204 0
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Scrape type for AJ78717: 2
2026-03-29 18:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-29 18:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b507cde-33b3-5619-ba75-c9ec008a6871 with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b507cde-33b3-5619-ba75-c9ec008a6871 with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b507cde-33b3-5619-ba75-c9ec008a6871, identifier: AJ78717
2026-03-29 18:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-29 18:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-29 18:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717 to the API
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:53:22Z',
'fuel_type': 'petrol',
'id': '7b507cde-33b3-5619-ba75-c9ec008a6871',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ78717',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 214777,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-17',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI ACT S line Sportpaket ultra',
'transmission': 'automatic',
'trim': 'S line Sportpaket ultra',
'year': 2016}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Saving data for AJ78717: {'auction_closing_time': 1774886002.0, 'created_time': 1773831157.482878, 'last_price_update_time': 1774809650.483852}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ78717') HTTP/1.1" 204 0
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Scrape type for BF31444: 2
2026-03-29 18:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-29 18:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a, identifier: BF31444
2026-03-29 18:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-29 18:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-29 18:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444 to the API
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:13:22Z',
'fuel_type': 'petrol',
'id': '0c906807-c8b8-59bc-ab89-cf9c4ef6256a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF31444',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 35391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-11',
'seller_name': None,
'title': 'Skoda Kamiq 1.0 TSI Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2022}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Saving data for BF31444: {'auction_closing_time': 1774883602.0, 'created_time': 1773400122.577479, 'last_price_update_time': 1774809650.909882}
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF31444') HTTP/1.1" 204 0
2026-03-29 18:40:50 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-29 18:40:50 [auto1.de] INFO: Scrape type for DG35961: 2
2026-03-29 18:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-29 18:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862f8487-4ffd-5030-9284-77a35a5d4a5d with scrape type 2
2026-03-29 18:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 862f8487-4ffd-5030-9284-77a35a5d4a5d with scrape type 2
2026-03-29 18:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 862f8487-4ffd-5030-9284-77a35a5d4a5d, identifier: DG35961
2026-03-29 18:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-29 18:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-29 18:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961 to the API
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:05:51Z',
'fuel_type': 'petrol',
'id': '862f8487-4ffd-5030-9284-77a35a5d4a5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG35961',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 99624,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-06-05',
'seller_name': None,
'title': 'Fiat Punto 1.2 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2005}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Saving data for DG35961: {'auction_closing_time': 1774883151.0, 'created_time': 1773689068.822942, 'last_price_update_time': 1774809651.387853}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG35961') HTTP/1.1" 204 0
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Scrape type for EU51889: 2
2026-03-29 18:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-29 18:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60053297-7423-53c8-8613-9e1c2f5def8c with scrape type 2
2026-03-29 18:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60053297-7423-53c8-8613-9e1c2f5def8c with scrape type 2
2026-03-29 18:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60053297-7423-53c8-8613-9e1c2f5def8c, identifier: EU51889
2026-03-29 18:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-29 18:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-29 18:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889 to the API
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:07:44Z',
'fuel_type': 'petrol',
'id': '60053297-7423-53c8-8613-9e1c2f5def8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU51889',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 205415,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-13',
'seller_name': None,
'title': 'Seat Ibiza 1.6 Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2008}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Saving data for EU51889: {'auction_closing_time': 1774883264.0, 'created_time': 1774608304.061345, 'last_price_update_time': 1774809651.957411}
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU51889') HTTP/1.1" 204 0
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-29 18:40:51 [auto1.de] INFO: Scrape type for SD83034: 0
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: US02373
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-29 18:40:51 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Scrape type for EG76856: 2
2026-03-29 18:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-29 18:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06, identifier: EG76856
2026-03-29 18:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-29 18:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-29 18:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856 to the API
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:42:23Z',
'fuel_type': 'petrol',
'id': '8ed4170d-8620-5afc-8278-3fe9f4bc1f06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG76856',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 114975,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seller_name': None,
'title': 'Seat Ateca 2.0 TSI FR 4Drive',
'transmission': 'automatic',
'trim': 'FR 4Drive',
'year': 2017}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Saving data for EG76856: {'auction_closing_time': 1774885343.0, 'created_time': 1773381186.949201, 'last_price_update_time': 1774809652.471172}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG76856') HTTP/1.1" 204 0
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Scrape type for SY84491: 2
2026-03-29 18:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-29 18:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c606a5ed-6074-5be9-b0dd-3bdd335275ff with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c606a5ed-6074-5be9-b0dd-3bdd335275ff with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c606a5ed-6074-5be9-b0dd-3bdd335275ff, identifier: SY84491
2026-03-29 18:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-29 18:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-29 18:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491 to the API
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:16:12Z',
'fuel_type': 'diesel',
'id': 'c606a5ed-6074-5be9-b0dd-3bdd335275ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY84491',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 144335,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-14',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi GT Line 4WD',
'transmission': 'automatic',
'trim': 'GT Line 4WD',
'year': 2016}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Saving data for SY84491: {'auction_closing_time': 1774883772.0, 'created_time': 1773917401.929951, 'last_price_update_time': 1774809652.943078}
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY84491') HTTP/1.1" 204 0
2026-03-29 18:40:52 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-29 18:40:52 [auto1.de] INFO: Scrape type for DR94699: 2
2026-03-29 18:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-29 18:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ecbeff-bd40-54df-908e-1b9c5783b25a with scrape type 2
2026-03-29 18:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ecbeff-bd40-54df-908e-1b9c5783b25a with scrape type 2
2026-03-29 18:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96ecbeff-bd40-54df-908e-1b9c5783b25a, identifier: DR94699
2026-03-29 18:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-29 18:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-29 18:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699 to the API
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:55:39Z',
'fuel_type': 'diesel',
'id': '96ecbeff-bd40-54df-908e-1b9c5783b25a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR94699',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 157714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-08',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2020}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Saving data for DR94699: {'auction_closing_time': 1774886139.0, 'created_time': 1773308162.650486, 'last_price_update_time': 1774809653.419122}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR94699') HTTP/1.1" 204 0
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT65842%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Scrape type for CT65842: 0
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Scrape type for TP63692: 2
2026-03-29 18:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-29 18:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with scrape type 2
2026-03-29 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with scrape type 2
2026-03-29 18:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4, identifier: TP63692
2026-03-29 18:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-29 18:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692
2026-03-29 18:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3742e63d-7217-51cc-a9eb-cd0e9a90cbe4 with identifier: TP63692 to the API
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:05:18Z',
'fuel_type': 'diesel',
'id': '3742e63d-7217-51cc-a9eb-cd0e9a90cbe4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP63692',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 186748,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-27',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-29 18:40:53 [auto1.de] INFO: Saving data for TP63692: {'auction_closing_time': 1774883118.0, 'created_time': 1773945770.31255, 'last_price_update_time': 1774809653.8613}
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP63692') HTTP/1.1" 204 0
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-29 18:40:53 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-29 18:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:40:57 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 6740 | hits on page: 40
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-29 18:40:57 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK13927%27 HTTP/1.1" 200 None
2026-03-29 18:40:57 [auto1.de] INFO: Scrape type for EK13927: 2
2026-03-29 18:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-03-29 18:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb282563-d73a-54cf-bbf3-3184ba59ade6 with scrape type 2
2026-03-29 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb282563-d73a-54cf-bbf3-3184ba59ade6 with scrape type 2
2026-03-29 18:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb282563-d73a-54cf-bbf3-3184ba59ade6, identifier: EK13927
2026-03-29 18:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-03-29 18:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927
2026-03-29 18:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb282563-d73a-54cf-bbf3-3184ba59ade6 with identifier: EK13927 to the API
2026-03-29 18:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:49:36Z',
'fuel_type': 'petrol',
'id': 'bb282563-d73a-54cf-bbf3-3184ba59ade6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK13927',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 267645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-02',
'seller_name': None,
'title': 'Seat Leon 1.8 TSI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK13927%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Saving data for EK13927: {'auction_closing_time': 1774885776.0, 'created_time': 1774723108.743238, 'last_price_update_time': 1774809658.125478}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK13927') HTTP/1.1" 204 0
2026-03-29 18:40:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR38354%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Scrape type for CR38354: 0
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Scrape type for GH07682: 2
2026-03-29 18:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-29 18:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed9becb-58eb-5e5d-ab29-1f07305abc6e with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed9becb-58eb-5e5d-ab29-1f07305abc6e with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fed9becb-58eb-5e5d-ab29-1f07305abc6e, identifier: GH07682
2026-03-29 18:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-29 18:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682
2026-03-29 18:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fed9becb-58eb-5e5d-ab29-1f07305abc6e with identifier: GH07682 to the API
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 440,
'expiration_date': '2026-03-30T15:33:38Z',
'fuel_type': 'petrol',
'id': 'fed9becb-58eb-5e5d-ab29-1f07305abc6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH07682',
'listing': 'auction',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 109980,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-24',
'seller_name': None,
'title': 'Porsche Cayenne GTS',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Saving data for GH07682: {'auction_closing_time': 1774884818.0, 'created_time': 1773402275.523204, 'last_price_update_time': 1774809658.640155}
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH07682') HTTP/1.1" 204 0
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-29 18:40:58 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-29 18:40:58 [auto1.de] INFO: Scrape type for WC28097: 2
2026-03-29 18:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097
2026-03-29 18:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c76c79-86a4-5acf-b698-d2567d48235d with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c76c79-86a4-5acf-b698-d2567d48235d with scrape type 2
2026-03-29 18:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82c76c79-86a4-5acf-b698-d2567d48235d, identifier: WC28097
2026-03-29 18:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097
2026-03-29 18:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097
2026-03-29 18:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82c76c79-86a4-5acf-b698-d2567d48235d with identifier: WC28097 to the API
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:32:40Z',
'fuel_type': 'diesel',
'id': '82c76c79-86a4-5acf-b698-d2567d48235d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC28097',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 195999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-24',
'seller_name': None,
'title': 'BMW 3er 330d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Saving data for WC28097: {'auction_closing_time': 1774884760.0, 'created_time': 1774636652.762221, 'last_price_update_time': 1774809659.029131}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC28097') HTTP/1.1" 204 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB32004%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for WB32004: 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97428%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for YY97428: 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for EM80186: 2
2026-03-29 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186
2026-03-29 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1b1e42-fa90-514a-814c-dd2cd41a2211 with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb1b1e42-fa90-514a-814c-dd2cd41a2211 with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb1b1e42-fa90-514a-814c-dd2cd41a2211, identifier: EM80186
2026-03-29 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186
2026-03-29 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186
2026-03-29 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb1b1e42-fa90-514a-814c-dd2cd41a2211 with identifier: EM80186 to the API
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:40Z',
'fuel_type': 'diesel',
'id': 'bb1b1e42-fa90-514a-814c-dd2cd41a2211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM80186',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 101692,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-19',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Saving data for EM80186: {'auction_closing_time': 1774884880.0, 'created_time': 1774350161.940641, 'last_price_update_time': 1774809659.520952}
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM80186') HTTP/1.1" 204 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT11802%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for HT11802: 0
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-29 18:40:59 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-29 18:40:59 [auto1.de] INFO: Scrape type for DB09685: 2
2026-03-29 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-29 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12da426-c89b-5f2a-bb11-2542b05274d6 with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12da426-c89b-5f2a-bb11-2542b05274d6 with scrape type 2
2026-03-29 18:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12da426-c89b-5f2a-bb11-2542b05274d6, identifier: DB09685
2026-03-29 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-29 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-29 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685 to the API
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:22:03Z',
'fuel_type': 'diesel',
'id': 'e12da426-c89b-5f2a-bb11-2542b05274d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB09685',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 137843,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-30',
'seller_name': None,
'title': 'Kia Sportage 2.0 CRDi Spirit 4WD',
'transmission': 'manual',
'trim': 'Spirit 4WD',
'year': 2015}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Saving data for DB09685: {'auction_closing_time': 1774884123.0, 'created_time': 1774293566.586896, 'last_price_update_time': 1774809660.103134}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB09685') HTTP/1.1" 204 0
2026-03-29 18:41:00 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Scrape type for HX36326: 0
2026-03-29 18:41:00 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Scrape type for SY11611: 2
2026-03-29 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-29 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfb3519-6ed5-5d2c-a088-086b690ffc3c with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adfb3519-6ed5-5d2c-a088-086b690ffc3c with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adfb3519-6ed5-5d2c-a088-086b690ffc3c, identifier: SY11611
2026-03-29 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-29 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611
2026-03-29 18:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adfb3519-6ed5-5d2c-a088-086b690ffc3c with identifier: SY11611 to the API
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:40:49Z',
'fuel_type': 'petrol',
'id': 'adfb3519-6ed5-5d2c-a088-086b690ffc3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY11611',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 105670,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-07',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Celebration',
'transmission': 'manual',
'trim': 'Stepway Celebration',
'year': 2018}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Saving data for SY11611: {'auction_closing_time': 1774885249.0, 'created_time': 1773946563.199743, 'last_price_update_time': 1774809660.545892}
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY11611') HTTP/1.1" 204 0
2026-03-29 18:41:00 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-29 18:41:00 [auto1.de] INFO: Scrape type for NE16717: 2
2026-03-29 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-29 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41d975f-1838-590a-814e-db4f5df86271 with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41d975f-1838-590a-814e-db4f5df86271 with scrape type 2
2026-03-29 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d41d975f-1838-590a-814e-db4f5df86271, identifier: NE16717
2026-03-29 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-29 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-29 18:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717 to the API
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:09:17Z',
'fuel_type': 'petrol',
'id': 'd41d975f-1838-590a-814e-db4f5df86271',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE16717',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 149299,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-09',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 350 CGI BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2013}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Saving data for NE16717: {'auction_closing_time': 1774883357.0, 'created_time': 1773383449.392621, 'last_price_update_time': 1774809661.091734}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE16717') HTTP/1.1" 204 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for ML35786: 2
2026-03-29 18:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-29 18:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d26b60-c34d-531f-beaa-f624ea762118 with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86d26b60-c34d-531f-beaa-f624ea762118 with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86d26b60-c34d-531f-beaa-f624ea762118, identifier: ML35786
2026-03-29 18:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-29 18:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-29 18:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786 to the API
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:11:34Z',
'fuel_type': 'diesel',
'id': '86d26b60-c34d-531f-beaa-f624ea762118',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML35786',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 421767,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-10',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Saving data for ML35786: {'auction_closing_time': 1774883494.0, 'created_time': 1773401361.049885, 'last_price_update_time': 1774809661.57425}
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML35786') HTTP/1.1" 204 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC06699%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for BC06699: 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG74367%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for YG74367: 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for BX62437: 0
2026-03-29 18:41:01 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-29 18:41:01 [auto1.de] INFO: Scrape type for XX92411: 2
2026-03-29 18:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-29 18:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e621235e-95f2-5302-a01d-6bf9f14bb7f8 with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e621235e-95f2-5302-a01d-6bf9f14bb7f8 with scrape type 2
2026-03-29 18:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e621235e-95f2-5302-a01d-6bf9f14bb7f8, identifier: XX92411
2026-03-29 18:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-29 18:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-29 18:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411 to the API
2026-03-29 18:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:41:11Z',
'fuel_type': 'diesel',
'id': 'e621235e-95f2-5302-a01d-6bf9f14bb7f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX92411',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 13504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-12-29',
'seller_name': None,
'title': 'Mercedes-Benz Citan 110 CDI PRO',
'transmission': 'automatic',
'trim': 'PRO',
'year': 2024}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Saving data for XX92411: {'auction_closing_time': 1774885271.0, 'created_time': 1774608612.086118, 'last_price_update_time': 1774809662.184992}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX92411') HTTP/1.1" 204 0
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Scrape type for TW39351: 2
2026-03-29 18:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-29 18:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2958a98a-3664-5621-b54a-e8414dc4dbc4 with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2958a98a-3664-5621-b54a-e8414dc4dbc4 with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2958a98a-3664-5621-b54a-e8414dc4dbc4, identifier: TW39351
2026-03-29 18:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-29 18:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-29 18:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351 to the API
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:57:13Z',
'fuel_type': 'petrol',
'id': '2958a98a-3664-5621-b54a-e8414dc4dbc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW39351',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 167602,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-07',
'seller_name': None,
'title': 'Audi A1 Sportback 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2014}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Saving data for TW39351: {'auction_closing_time': 1774886233.0, 'created_time': 1773383295.376422, 'last_price_update_time': 1774809662.665204}
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW39351') HTTP/1.1" 204 0
2026-03-29 18:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-29 18:41:02 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-29 18:41:02 [auto1.de] INFO: Scrape type for EA07160: 2
2026-03-29 18:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-29 18:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d831d3c5-504a-56e5-aefb-c068d82c1691 with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d831d3c5-504a-56e5-aefb-c068d82c1691 with scrape type 2
2026-03-29 18:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d831d3c5-504a-56e5-aefb-c068d82c1691, identifier: EA07160
2026-03-29 18:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-29 18:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160
2026-03-29 18:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d831d3c5-504a-56e5-aefb-c068d82c1691 with identifier: EA07160 to the API
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:43:51Z',
'fuel_type': 'petrol',
'id': 'd831d3c5-504a-56e5-aefb-c068d82c1691',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA07160',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 52498,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-15',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Saving data for EA07160: {'auction_closing_time': 1774885431.0, 'created_time': 1774522463.055979, 'last_price_update_time': 1774809663.080267}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA07160') HTTP/1.1" 204 0
2026-03-29 18:41:03 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06555%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for VN06555: 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for MY48051: 2
2026-03-29 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-29 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 607cd388-1ec9-5ecb-bbcc-d483e737cb20, identifier: MY48051
2026-03-29 18:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-29 18:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051
2026-03-29 18:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 607cd388-1ec9-5ecb-bbcc-d483e737cb20 with identifier: MY48051 to the API
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 239,
'expiration_date': '2026-03-30T15:03:48Z',
'fuel_type': 'diesel',
'id': '607cd388-1ec9-5ecb-bbcc-d483e737cb20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY48051',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 111287,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-14',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 300 d 4MATIC AVANTGARDE EDITION 19 lang',
'transmission': 'automatic',
'trim': '4MATIC AVANTGARDE EDITION 19 lang',
'year': 2019}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Saving data for MY48051: {'auction_closing_time': 1774883028.0, 'created_time': 1774521425.753132, 'last_price_update_time': 1774809663.527227}
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY48051') HTTP/1.1" 204 0
2026-03-29 18:41:03 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-29 18:41:03 [auto1.de] INFO: Scrape type for UC14298: 2
2026-03-29 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-29 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18cedc76-8d4f-5334-a121-75261363c320 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18cedc76-8d4f-5334-a121-75261363c320 with scrape type 2
2026-03-29 18:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18cedc76-8d4f-5334-a121-75261363c320, identifier: UC14298
2026-03-29 18:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-29 18:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-29 18:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298 to the API
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:48:40Z',
'fuel_type': 'petrol',
'id': '18cedc76-8d4f-5334-a121-75261363c320',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC14298',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'up!',
'odometer': 149490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-29',
'seller_name': None,
'title': 'Volkswagen up! 1.0 Move up!',
'transmission': 'manual',
'trim': 'Move',
'year': 2012}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Saving data for UC14298: {'auction_closing_time': 1774885720.0, 'created_time': 1774608198.022563, 'last_price_update_time': 1774809664.063158}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC14298') HTTP/1.1" 204 0
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Scrape type for DJ76178: 2
2026-03-29 18:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-29 18:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4, identifier: DJ76178
2026-03-29 18:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-29 18:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-29 18:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178 to the API
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:31:56Z',
'fuel_type': 'petrol',
'id': '12ec19a0-9dda-57ad-96dd-a4a9d1192aa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ76178',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 207047,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-30',
'seller_name': None,
'title': 'Seat Alhambra 2.8 V6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2005}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Saving data for DJ76178: {'auction_closing_time': 1774884716.0, 'created_time': 1773380506.854756, 'last_price_update_time': 1774809664.600275}
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ76178') HTTP/1.1" 204 0
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78048%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Scrape type for FJ78048: 0
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-29 18:41:04 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-29 18:41:04 [auto1.de] INFO: Scrape type for FZ02201: 2
2026-03-29 18:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-29 18:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with scrape type 2
2026-03-29 18:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fa5303c-8ac4-5446-b0a9-88a39c883c47, identifier: FZ02201
2026-03-29 18:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-29 18:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-29 18:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201 to the API
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:40:34Z',
'fuel_type': 'diesel',
'id': '0fa5303c-8ac4-5446-b0a9-88a39c883c47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ02201',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Country Tourer',
'odometer': 154239,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-01',
'seller_name': None,
'title': 'Opel Insignia Country Tourer 2.0 CDTI Basis ecoFlex',
'transmission': 'manual',
'trim': 'Basis ecoFlex',
'year': 2015}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Saving data for FZ02201: {'auction_closing_time': 1774885234.0, 'created_time': 1773383109.789682, 'last_price_update_time': 1774809665.086403}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ02201') HTTP/1.1" 204 0
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Scrape type for NN41224: 2
2026-03-29 18:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-29 18:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24577de-6e34-5ea3-ace2-47233e613236 with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24577de-6e34-5ea3-ace2-47233e613236 with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24577de-6e34-5ea3-ace2-47233e613236, identifier: NN41224
2026-03-29 18:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-29 18:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-29 18:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224 to the API
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:13:46Z',
'fuel_type': 'diesel',
'id': 'd24577de-6e34-5ea3-ace2-47233e613236',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN41224',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 204751,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-31',
'seller_name': None,
'title': 'Skoda Roomster 1.6 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2011}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Saving data for NN41224: {'auction_closing_time': 1774883626.0, 'created_time': 1773305170.778331, 'last_price_update_time': 1774809665.570479}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN41224') HTTP/1.1" 204 0
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: US46384
2026-03-29 18:41:05 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-29 18:41:05 [auto1.de] INFO: Scrape type for JB03726: 2
2026-03-29 18:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-29 18:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7cb431-cfe0-5600-9637-9f23e580151b with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7cb431-cfe0-5600-9637-9f23e580151b with scrape type 2
2026-03-29 18:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7cb431-cfe0-5600-9637-9f23e580151b, identifier: JB03726
2026-03-29 18:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-29 18:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-29 18:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726 to the API
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:30:51Z',
'fuel_type': 'diesel',
'id': 'bb7cb431-cfe0-5600-9637-9f23e580151b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB03726',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 149175,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-25',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Saving data for JB03726: {'auction_closing_time': 1774884651.0, 'created_time': 1773341203.426903, 'last_price_update_time': 1774809666.014858}
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB03726') HTTP/1.1" 204 0
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for BZ42354: 2
2026-03-29 18:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354
2026-03-29 18:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80d1dcea-8cb9-5771-b10e-2bd298219f4c with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80d1dcea-8cb9-5771-b10e-2bd298219f4c with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80d1dcea-8cb9-5771-b10e-2bd298219f4c, identifier: BZ42354
2026-03-29 18:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354
2026-03-29 18:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354
2026-03-29 18:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80d1dcea-8cb9-5771-b10e-2bd298219f4c with identifier: BZ42354 to the API
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:43:09Z',
'fuel_type': 'diesel',
'id': '80d1dcea-8cb9-5771-b10e-2bd298219f4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ42354',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5 Cross Tourer',
'odometer': 397870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-26',
'seller_name': None,
'title': 'Citroen C5 Cross Tourer 2.2 HDi',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Saving data for BZ42354: {'auction_closing_time': 1774885389.0, 'created_time': 1773831209.503042, 'last_price_update_time': 1774809666.529563}
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ42354') HTTP/1.1" 204 0
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for UA59883: 0
2026-03-29 18:41:06 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-29 18:41:06 [auto1.de] INFO: Scrape type for PU11267: 2
2026-03-29 18:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-29 18:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8caa3d6-751b-547e-91dd-070393e16382 with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8caa3d6-751b-547e-91dd-070393e16382 with scrape type 2
2026-03-29 18:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8caa3d6-751b-547e-91dd-070393e16382, identifier: PU11267
2026-03-29 18:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:06 [scrapy.extensions.logstats] INFO: Crawled 75 pages (at 11 pages/min), scraped 556 items (at 108 items/min)
2026-03-29 18:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-29 18:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267
2026-03-29 18:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8caa3d6-751b-547e-91dd-070393e16382 with identifier: PU11267 to the API
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:42:35Z',
'fuel_type': 'petrol',
'id': 'd8caa3d6-751b-547e-91dd-070393e16382',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU11267',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 37127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-03',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis passion',
'transmission': 'automatic',
'trim': 'Basis passion',
'year': 2019}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Saving data for PU11267: {'auction_closing_time': 1774885355.0, 'created_time': 1774521870.657776, 'last_price_update_time': 1774809667.097506}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU11267') HTTP/1.1" 204 0
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Scrape type for EL79145: 2
2026-03-29 18:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-29 18:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d, identifier: EL79145
2026-03-29 18:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-29 18:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-29 18:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145 to the API
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:46:55Z',
'fuel_type': 'petrol',
'id': 'e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL79145',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 96873,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-21',
'seller_name': None,
'title': 'Seat Tarraco 2.0 TSI Xcellence 4Drive',
'transmission': 'automatic',
'trim': 'Xcellence 4Drive',
'year': 2020}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Saving data for EL79145: {'auction_closing_time': 1774885615.0, 'created_time': 1773861753.65887, 'last_price_update_time': 1774809667.559995}
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL79145') HTTP/1.1" 204 0
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Scrape type for AM22108: 0
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-29 18:41:07 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-29 18:41:07 [auto1.de] INFO: Scrape type for AG88480: 2
2026-03-29 18:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-29 18:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858c7846-9150-55e7-a719-a197d896567e with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 858c7846-9150-55e7-a719-a197d896567e with scrape type 2
2026-03-29 18:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 858c7846-9150-55e7-a719-a197d896567e, identifier: AG88480
2026-03-29 18:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-29 18:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-29 18:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480 to the API
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:20:07Z',
'fuel_type': 'diesel',
'id': '858c7846-9150-55e7-a719-a197d896567e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG88480',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 204182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-05',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2009}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Saving data for AG88480: {'auction_closing_time': 1774884007.0, 'created_time': 1773861288.338836, 'last_price_update_time': 1774809668.104953}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG88480') HTTP/1.1" 204 0
2026-03-29 18:41:08 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for AV40802: 2
2026-03-29 18:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-29 18:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f1e5439-69a0-583a-ab1a-f64ba770b286 with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f1e5439-69a0-583a-ab1a-f64ba770b286 with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f1e5439-69a0-583a-ab1a-f64ba770b286, identifier: AV40802
2026-03-29 18:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-29 18:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802
2026-03-29 18:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f1e5439-69a0-583a-ab1a-f64ba770b286 with identifier: AV40802 to the API
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:06:57Z',
'fuel_type': 'diesel',
'id': '4f1e5439-69a0-583a-ab1a-f64ba770b286',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV40802',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 191544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-03',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2015}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Saving data for AV40802: {'auction_closing_time': 1774883217.0, 'created_time': 1774003057.35564, 'last_price_update_time': 1774809668.593867}
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV40802') HTTP/1.1" 204 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for XG58500: 2
2026-03-29 18:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-29 18:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42, identifier: XG58500
2026-03-29 18:41:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for EU33293: 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB14997%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for BB14997: 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for DY72609: 0
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-29 18:41:08 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-29 18:41:08 [auto1.de] INFO: Scrape type for FF39586: 2
2026-03-29 18:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-29 18:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e60c8e2-9151-5dde-8e0e-10f649360f5f with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e60c8e2-9151-5dde-8e0e-10f649360f5f with scrape type 2
2026-03-29 18:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e60c8e2-9151-5dde-8e0e-10f649360f5f, identifier: FF39586
2026-03-29 18:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-29 18:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-29 18:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500 to the API
2026-03-29 18:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:35:09Z',
'fuel_type': 'petrol',
'id': '0af9bfdb-44c0-542c-9938-0fe1aa99ed42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG58500',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 128302,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-22',
'seller_name': None,
'title': 'Ford Fiesta 1.0 Celebration',
'transmission': 'manual',
'trim': 'Celebration',
'year': 2016}
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Saving data for XG58500: {'auction_closing_time': 1774884909.0, 'created_time': 1773137723.070419, 'last_price_update_time': 1774809669.224169}
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG58500') HTTP/1.1" 204 0
2026-03-29 18:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-29 18:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586
2026-03-29 18:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e60c8e2-9151-5dde-8e0e-10f649360f5f with identifier: FF39586 to the API
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:25:58Z',
'fuel_type': 'diesel',
'id': '3e60c8e2-9151-5dde-8e0e-10f649360f5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF39586',
'listing': 'auction',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 180689,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-11',
'seller_name': None,
'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Saving data for FF39586: {'auction_closing_time': 1774884358.0, 'created_time': 1773301779.583936, 'last_price_update_time': 1774809669.610705}
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF39586') HTTP/1.1" 204 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: US51436
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for KM67977: 2
2026-03-29 18:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-29 18:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d80ea7-a34e-5aae-afcf-dff2e9401bda with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d80ea7-a34e-5aae-afcf-dff2e9401bda with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06d80ea7-a34e-5aae-afcf-dff2e9401bda, identifier: KM67977
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for RG61391: 0
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-29 18:41:09 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-29 18:41:09 [auto1.de] INFO: Scrape type for XA15787: 2
2026-03-29 18:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-29 18:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e078c114-4301-5eca-8554-b012db12e2ee with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e078c114-4301-5eca-8554-b012db12e2ee with scrape type 2
2026-03-29 18:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e078c114-4301-5eca-8554-b012db12e2ee, identifier: XA15787
2026-03-29 18:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-29 18:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-29 18:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977 to the API
2026-03-29 18:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:50:10Z',
'fuel_type': 'diesel',
'id': '06d80ea7-a34e-5aae-afcf-dff2e9401bda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM67977',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 144554,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-28',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Alltrack BlueMotion 4Motion',
'transmission': 'automatic',
'trim': 'Alltrack BlueMotion 4Motion',
'year': 2017}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Saving data for KM67977: {'auction_closing_time': 1774885810.0, 'created_time': 1774264835.565672, 'last_price_update_time': 1774809670.223364}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM67977') HTTP/1.1" 204 0
2026-03-29 18:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-29 18:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787
2026-03-29 18:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e078c114-4301-5eca-8554-b012db12e2ee with identifier: XA15787 to the API
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:42:12Z',
'fuel_type': 'diesel',
'id': 'e078c114-4301-5eca-8554-b012db12e2ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA15787',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 244780,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-15',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Saving data for XA15787: {'auction_closing_time': 1774885332.0, 'created_time': 1773428740.461163, 'last_price_update_time': 1774809670.504693}
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA15787') HTTP/1.1" 204 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for PA77354: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP14792%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for FP14792: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for EJ47615: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for PG49368: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for YB02361: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for PG96137: 0
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-29 18:41:10 [auto1.de] INFO: Scrape type for XL13857: 2
2026-03-29 18:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-29 18:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with scrape type 2
2026-03-29 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with scrape type 2
2026-03-29 18:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2, identifier: XL13857
2026-03-29 18:41:10 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-29 18:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-29 18:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857
2026-03-29 18:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2 with identifier: XL13857 to the API
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:22:52Z',
'fuel_type': 'petrol',
'id': 'f4fa18d9-4d5d-5dfa-8f91-7cdb401bbde2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL13857',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 25693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-03',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2018}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Saving data for XL13857: {'auction_closing_time': 1774884172.0, 'created_time': 1774521563.494481, 'last_price_update_time': 1774809671.028197}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL13857') HTTP/1.1" 204 0
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Scrape type for PN86617: 0
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Scrape type for TJ39363: 2
2026-03-29 18:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-29 18:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a649c8-8819-5f61-b364-b382601f4676 with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97a649c8-8819-5f61-b364-b382601f4676 with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97a649c8-8819-5f61-b364-b382601f4676, identifier: TJ39363
2026-03-29 18:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-29 18:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-29 18:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363 to the API
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:21:33Z',
'fuel_type': 'diesel',
'id': '97a649c8-8819-5f61-b364-b382601f4676',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ39363',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 198552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-12',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Saving data for TJ39363: {'auction_closing_time': 1774884093.0, 'created_time': 1773686339.757991, 'last_price_update_time': 1774809671.58906}
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ39363') HTTP/1.1" 204 0
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Scrape type for BA43321: 0
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Scrape type for MG32866: 0
2026-03-29 18:41:11 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-29 18:41:11 [auto1.de] INFO: Scrape type for NY45710: 2
2026-03-29 18:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-29 18:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e1c178-7256-522c-a1ef-c7ba89be420c with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e1c178-7256-522c-a1ef-c7ba89be420c with scrape type 2
2026-03-29 18:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e1c178-7256-522c-a1ef-c7ba89be420c, identifier: NY45710
2026-03-29 18:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-29 18:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-29 18:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710 to the API
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:22Z',
'fuel_type': 'diesel',
'id': '55e1c178-7256-522c-a1ef-c7ba89be420c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY45710',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 110885,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-03',
'seller_name': None,
'title': 'Audi Q2 35 TDI quattro advanced',
'transmission': 'automatic',
'trim': 'quattro advanced',
'year': 2022}
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-29 18:41:12 [auto1.de] INFO: Saving data for NY45710: {'auction_closing_time': 1774886302.0, 'created_time': 1774035460.117756, 'last_price_update_time': 1774809672.097224}
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY45710') HTTP/1.1" 204 0
2026-03-29 18:41:12 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-29 18:41:12 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-29 18:41:12 [auto1.de] INFO: Scrape type for EW06930: 0
2026-03-29 18:41:12 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-29 18:41:12 [auto1.de] INFO: Scrape type for RX49945: 2
2026-03-29 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-29 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c519ae2b-43ea-5bcb-bf09-a230dbcded80 with scrape type 2
2026-03-29 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c519ae2b-43ea-5bcb-bf09-a230dbcded80 with scrape type 2
2026-03-29 18:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c519ae2b-43ea-5bcb-bf09-a230dbcded80, identifier: RX49945
2026-03-29 18:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-29 18:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-29 18:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945 to the API
2026-03-29 18:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 199,
'expiration_date': '2026-03-30T15:13:16Z',
'fuel_type': 'diesel',
'id': 'c519ae2b-43ea-5bcb-bf09-a230dbcded80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX49945',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 84708,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-07',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
'transmission': 'automatic',
'trim': 'Generation Six 4Motion',
'year': 2019}
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Saving data for RX49945: {'auction_closing_time': 1774883596.0, 'created_time': 1773307362.034399, 'last_price_update_time': 1774809673.433484}
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX49945') HTTP/1.1" 204 0
2026-03-29 18:41:13 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-29 18:41:13 [auto1.de] INFO: Scrape type for BK83629: 2
2026-03-29 18:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-29 18:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b99433-4430-572a-bf83-d3422960a74c with scrape type 2
2026-03-29 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b99433-4430-572a-bf83-d3422960a74c with scrape type 2
2026-03-29 18:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b99433-4430-572a-bf83-d3422960a74c, identifier: BK83629
2026-03-29 18:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-29 18:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-29 18:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629 to the API
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:46:34Z',
'fuel_type': 'diesel',
'id': '08b99433-4430-572a-bf83-d3422960a74c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK83629',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 247105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-25',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Saving data for BK83629: {'auction_closing_time': 1774885594.0, 'created_time': 1773775072.915129, 'last_price_update_time': 1774809674.032518}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK83629') HTTP/1.1" 204 0
2026-03-29 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Scrape type for LH67751: 2
2026-03-29 18:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-29 18:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baeb855d-c619-571d-8227-3504a3316b6a with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baeb855d-c619-571d-8227-3504a3316b6a with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baeb855d-c619-571d-8227-3504a3316b6a, identifier: LH67751
2026-03-29 18:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-29 18:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-29 18:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751 to the API
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:11:15Z',
'fuel_type': 'petrol',
'id': 'baeb855d-c619-571d-8227-3504a3316b6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH67751',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 65035,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-23',
'seller_name': None,
'title': 'Renault Captur 1.2 TCe Luxe',
'transmission': 'automatic',
'trim': 'Luxe',
'year': 2014}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Saving data for LH67751: {'auction_closing_time': 1774883475.0, 'created_time': 1774608194.716891, 'last_price_update_time': 1774809674.502599}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH67751') HTTP/1.1" 204 0
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Scrape type for TS61714: 2
2026-03-29 18:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-29 18:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 644920f7-8d9d-5b33-9bcf-dee042fe0efe with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 644920f7-8d9d-5b33-9bcf-dee042fe0efe with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 644920f7-8d9d-5b33-9bcf-dee042fe0efe, identifier: TS61714
2026-03-29 18:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-29 18:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-29 18:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714 to the API
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:23:43Z',
'fuel_type': 'petrol',
'id': '644920f7-8d9d-5b33-9bcf-dee042fe0efe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS61714',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 111922,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-28',
'seller_name': None,
'title': 'Citroen C3 1.2 e-VTi Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2015}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Saving data for TS61714: {'auction_closing_time': 1774884223.0, 'created_time': 1773657830.042563, 'last_price_update_time': 1774809674.944075}
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS61714') HTTP/1.1" 204 0
2026-03-29 18:41:14 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-29 18:41:14 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-29 18:41:14 [auto1.de] INFO: Scrape type for BG27909: 2
2026-03-29 18:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-29 18:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c9d574-5ffb-5619-8435-005227d17693 with scrape type 2
2026-03-29 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c9d574-5ffb-5619-8435-005227d17693 with scrape type 2
2026-03-29 18:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c9d574-5ffb-5619-8435-005227d17693, identifier: BG27909
2026-03-29 18:41:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-29 18:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909
2026-03-29 18:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c9d574-5ffb-5619-8435-005227d17693 with identifier: BG27909 to the API
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:08:04Z',
'fuel_type': 'petrol',
'id': '36c9d574-5ffb-5619-8435-005227d17693',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG27909',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 39519,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-23',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Sport Edition',
'transmission': 'manual',
'trim': 'Sport Edition',
'year': 2005}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-29 18:41:15 [auto1.de] INFO: Saving data for BG27909: {'auction_closing_time': 1774883284.0, 'created_time': 1774521951.273152, 'last_price_update_time': 1774809675.380891}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG27909') HTTP/1.1" 204 0
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-29 18:41:15 [auto1.de] INFO: Scrape type for HY54532: 2
2026-03-29 18:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-29 18:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 174b828c-aa89-5c29-a97f-720383dbdb48 with scrape type 2
2026-03-29 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 174b828c-aa89-5c29-a97f-720383dbdb48 with scrape type 2
2026-03-29 18:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 174b828c-aa89-5c29-a97f-720383dbdb48, identifier: HY54532
2026-03-29 18:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-29 18:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-29 18:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532 to the API
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:14:13Z',
'fuel_type': 'petrol',
'id': '174b828c-aa89-5c29-a97f-720383dbdb48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY54532',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 56341,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-14',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2020}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-29 18:41:15 [auto1.de] INFO: Saving data for HY54532: {'auction_closing_time': 1774883653.0, 'created_time': 1773427044.165479, 'last_price_update_time': 1774809675.851069}
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY54532') HTTP/1.1" 204 0
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-29 18:41:15 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-29 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Scrape type for GC84828: 2
2026-03-29 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-29 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befc586c-e755-5a3b-9eac-511e3c17da8e with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item befc586c-e755-5a3b-9eac-511e3c17da8e with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: befc586c-e755-5a3b-9eac-511e3c17da8e, identifier: GC84828
2026-03-29 18:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-29 18:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-29 18:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828 to the API
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:32:03Z',
'fuel_type': 'petrol',
'id': 'befc586c-e755-5a3b-9eac-511e3c17da8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC84828',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 22334,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-07',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2023}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Saving data for GC84828: {'auction_closing_time': 1774884723.0, 'created_time': 1774607778.537597, 'last_price_update_time': 1774809676.416984}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC84828') HTTP/1.1" 204 0
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Scrape type for SB04104: 2
2026-03-29 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-29 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810e3f38-3373-571a-ae95-ca7dda2783d0 with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810e3f38-3373-571a-ae95-ca7dda2783d0 with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 810e3f38-3373-571a-ae95-ca7dda2783d0, identifier: SB04104
2026-03-29 18:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-29 18:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-29 18:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104 to the API
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:41:36Z',
'fuel_type': 'diesel',
'id': '810e3f38-3373-571a-ae95-ca7dda2783d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB04104',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 219697,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-08',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Saving data for SB04104: {'auction_closing_time': 1774885296.0, 'created_time': 1773307850.246341, 'last_price_update_time': 1774809676.854404}
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB04104') HTTP/1.1" 204 0
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Scrape type for AY33433: 0
2026-03-29 18:41:16 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-29 18:41:16 [auto1.de] INFO: Scrape type for AH65486: 2
2026-03-29 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-29 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcae66b3-402f-5baa-b5b9-f5dea7b03047 with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcae66b3-402f-5baa-b5b9-f5dea7b03047 with scrape type 2
2026-03-29 18:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcae66b3-402f-5baa-b5b9-f5dea7b03047, identifier: AH65486
2026-03-29 18:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-29 18:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486
2026-03-29 18:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcae66b3-402f-5baa-b5b9-f5dea7b03047 with identifier: AH65486 to the API
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 335,
'expiration_date': '2026-03-30T15:49:03Z',
'fuel_type': 'petrol',
'id': 'bcae66b3-402f-5baa-b5b9-f5dea7b03047',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH65486',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Phaeton',
'odometer': 148377,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-16',
'seller_name': None,
'title': 'Volkswagen Phaeton 4.2 V8 4Motion',
'transmission': 'automatic',
'trim': '4Motion',
'year': 2009}
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Saving data for AH65486: {'auction_closing_time': 1774885743.0, 'created_time': 1774522095.997701, 'last_price_update_time': 1774809677.280978}
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH65486') HTTP/1.1" 204 0
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Scrape type for TC39197: 2
2026-03-29 18:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197
2026-03-29 18:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834d2273-1693-51b5-9a09-b261122eba2f with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 834d2273-1693-51b5-9a09-b261122eba2f with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 834d2273-1693-51b5-9a09-b261122eba2f, identifier: TC39197
2026-03-29 18:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197
2026-03-29 18:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197
2026-03-29 18:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197 to the API
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:05:54Z',
'fuel_type': 'petrol',
'id': '834d2273-1693-51b5-9a09-b261122eba2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC39197',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Grand Vitara',
'odometer': 166895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-13',
'seller_name': None,
'title': 'Suzuki Grand Vitara 2.4 VVT Comfort',
'transmission': 'automatic',
'trim': 'VVT Comfort',
'year': 2008}
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Saving data for TC39197: {'auction_closing_time': 1774883154.0, 'created_time': 1774510532.408597, 'last_price_update_time': 1774809677.731803}
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC39197') HTTP/1.1" 204 0
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-29 18:41:17 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-29 18:41:17 [auto1.de] INFO: Scrape type for MH69826: 2
2026-03-29 18:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-29 18:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3b8ddb2-9118-5795-9e70-c35dfed8b986 with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3b8ddb2-9118-5795-9e70-c35dfed8b986 with scrape type 2
2026-03-29 18:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3b8ddb2-9118-5795-9e70-c35dfed8b986, identifier: MH69826
2026-03-29 18:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-29 18:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-29 18:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826 to the API
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:07Z',
'fuel_type': 'petrol',
'id': 'a3b8ddb2-9118-5795-9e70-c35dfed8b986',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH69826',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 68421,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-27',
'seller_name': None,
'title': 'Volkswagen Passat 1.5 TSI ACT Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2023}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Saving data for MH69826: {'auction_closing_time': 1774885507.0, 'created_time': 1773830790.420453, 'last_price_update_time': 1774809678.296074}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH69826') HTTP/1.1" 204 0
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Scrape type for EU27466: 2
2026-03-29 18:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-29 18:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7, identifier: EU27466
2026-03-29 18:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-29 18:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466
2026-03-29 18:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7 with identifier: EU27466 to the API
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:37:47Z',
'fuel_type': 'petrol',
'id': 'ef3f38f0-f9c9-5db1-ac48-6f281e5eaea7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU27466',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf III',
'odometer': 192141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1995-03-20',
'seller_name': None,
'title': 'Volkswagen Golf III 2.0',
'transmission': 'manual',
'trim': '',
'year': 1995}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Saving data for EU27466: {'auction_closing_time': 1774885067.0, 'created_time': 1774522125.880616, 'last_price_update_time': 1774809678.710558}
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU27466') HTTP/1.1" 204 0
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Scrape type for BC43890: 0
2026-03-29 18:41:18 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-29 18:41:18 [auto1.de] INFO: Scrape type for ZR48762: 2
2026-03-29 18:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-29 18:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a165d659-cf53-5485-8d8f-a7b809a13826 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a165d659-cf53-5485-8d8f-a7b809a13826 with scrape type 2
2026-03-29 18:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a165d659-cf53-5485-8d8f-a7b809a13826, identifier: ZR48762
2026-03-29 18:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-29 18:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-29 18:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762 to the API
2026-03-29 18:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:54:19Z',
'fuel_type': 'petrol',
'id': 'a165d659-cf53-5485-8d8f-a7b809a13826',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR48762',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 178540,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-03',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 280 T 4Matic Avantgarde',
'transmission': 'automatic',
'trim': 'T 4Matic Avantgarde',
'year': 2007}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Saving data for ZR48762: {'auction_closing_time': 1774886059.0, 'created_time': 1773427831.35327, 'last_price_update_time': 1774809679.178127}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR48762') HTTP/1.1" 204 0
2026-03-29 18:41:19 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Scrape type for DZ70756: 2
2026-03-29 18:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-29 18:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20238c3-58c1-5329-ad11-23c265dac4e5 with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20238c3-58c1-5329-ad11-23c265dac4e5 with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b20238c3-58c1-5329-ad11-23c265dac4e5, identifier: DZ70756
2026-03-29 18:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-29 18:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-29 18:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756 to the API
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:53:18Z',
'fuel_type': 'diesel',
'id': 'b20238c3-58c1-5329-ad11-23c265dac4e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ70756',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 182385,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-28',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.9 TDI Tour',
'transmission': 'automatic',
'trim': 'Tour',
'year': 2007}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Saving data for DZ70756: {'auction_closing_time': 1774885998.0, 'created_time': 1773131948.902892, 'last_price_update_time': 1774809679.663294}
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ70756') HTTP/1.1" 204 0
2026-03-29 18:41:19 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-29 18:41:19 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-29 18:41:19 [auto1.de] INFO: Scrape type for KC98509: 2
2026-03-29 18:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-29 18:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32fb9f9-eae3-5351-b884-495dfcd6aafa with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e32fb9f9-eae3-5351-b884-495dfcd6aafa with scrape type 2
2026-03-29 18:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e32fb9f9-eae3-5351-b884-495dfcd6aafa, identifier: KC98509
2026-03-29 18:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-29 18:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-29 18:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509 to the API
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:22:00Z',
'fuel_type': 'diesel',
'id': 'e32fb9f9-eae3-5351-b884-495dfcd6aafa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC98509',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 250642,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-28',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Saving data for KC98509: {'auction_closing_time': 1774884120.0, 'created_time': 1774293697.003453, 'last_price_update_time': 1774809680.126988}
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC98509') HTTP/1.1" 204 0
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67532%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Scrape type for ZY67532: 2
2026-03-29 18:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532
2026-03-29 18:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19508f6-a268-51f3-84a0-d184aab8965d with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19508f6-a268-51f3-84a0-d184aab8965d with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b19508f6-a268-51f3-84a0-d184aab8965d, identifier: ZY67532
2026-03-29 18:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532
2026-03-29 18:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532
2026-03-29 18:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b19508f6-a268-51f3-84a0-d184aab8965d with identifier: ZY67532 to the API
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:40:31Z',
'fuel_type': 'diesel',
'id': 'b19508f6-a268-51f3-84a0-d184aab8965d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY67532',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 192370,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-01',
'seller_name': None,
'title': 'BMW 5er 525d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2013}
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67532%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Saving data for ZY67532: {'auction_closing_time': 1774885231.0, 'created_time': 1774723121.666072, 'last_price_update_time': 1774809680.625508}
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY67532') HTTP/1.1" 204 0
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-29 18:41:20 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-29 18:41:20 [auto1.de] INFO: Scrape type for FY30353: 2
2026-03-29 18:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-29 18:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3c3729-9171-5c1c-bb0d-07865d298010 with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b3c3729-9171-5c1c-bb0d-07865d298010 with scrape type 2
2026-03-29 18:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b3c3729-9171-5c1c-bb0d-07865d298010, identifier: FY30353
2026-03-29 18:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-29 18:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-29 18:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353 to the API
2026-03-29 18:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:23:34Z',
'fuel_type': 'diesel',
'id': '4b3c3729-9171-5c1c-bb0d-07865d298010',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY30353',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 181354,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-03',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2010}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Saving data for FY30353: {'auction_closing_time': 1774884214.0, 'created_time': 1773305735.967438, 'last_price_update_time': 1774809681.1507}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY30353') HTTP/1.1" 204 0
2026-03-29 18:41:21 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:21 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Scrape type for RN84486: 2
2026-03-29 18:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-29 18:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72d3156-6b82-5078-99f6-76c8850b5177 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72d3156-6b82-5078-99f6-76c8850b5177 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a72d3156-6b82-5078-99f6-76c8850b5177, identifier: RN84486
2026-03-29 18:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-29 18:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486
2026-03-29 18:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a72d3156-6b82-5078-99f6-76c8850b5177 with identifier: RN84486 to the API
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:32:23Z',
'fuel_type': 'petrol',
'id': 'a72d3156-6b82-5078-99f6-76c8850b5177',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN84486',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 200666,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-30',
'seller_name': None,
'title': 'Opel Corsa 1.4 Satellite',
'transmission': 'manual',
'trim': 'Satellite',
'year': 2011}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Saving data for RN84486: {'auction_closing_time': 1774884743.0, 'created_time': 1774522092.095282, 'last_price_update_time': 1774809681.610904}
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN84486') HTTP/1.1" 204 0
2026-03-29 18:41:21 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Scrape type for WR55651: 0
2026-03-29 18:41:21 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-29 18:41:21 [auto1.de] INFO: Scrape type for PZ64082: 2
2026-03-29 18:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-29 18:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 930329d9-c3c2-5584-ac29-37e14b628783 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 930329d9-c3c2-5584-ac29-37e14b628783 with scrape type 2
2026-03-29 18:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 930329d9-c3c2-5584-ac29-37e14b628783, identifier: PZ64082
2026-03-29 18:41:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-29 18:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-29 18:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082 to the API
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:55:22Z',
'fuel_type': 'diesel',
'id': '930329d9-c3c2-5584-ac29-37e14b628783',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ64082',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 238797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Saving data for PZ64082: {'auction_closing_time': 1774886122.0, 'created_time': 1774265340.259852, 'last_price_update_time': 1774809682.090704}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ64082') HTTP/1.1" 204 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for BS83474: 2
2026-03-29 18:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-29 18:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0f230c-2673-5c6a-850b-1043a2580dfb with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c0f230c-2673-5c6a-850b-1043a2580dfb with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c0f230c-2673-5c6a-850b-1043a2580dfb, identifier: BS83474
2026-03-29 18:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-29 18:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-29 18:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474 to the API
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:12:51Z',
'fuel_type': 'diesel',
'id': '9c0f230c-2673-5c6a-850b-1043a2580dfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS83474',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 184613,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-20',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 d Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2017}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Saving data for BS83474: {'auction_closing_time': 1774883571.0, 'created_time': 1772543696.739905, 'last_price_update_time': 1774809682.602671}
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS83474') HTTP/1.1" 204 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for EB23649: 0
2026-03-29 18:41:22 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-29 18:41:22 [auto1.de] INFO: Scrape type for RU04475: 2
2026-03-29 18:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475
2026-03-29 18:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e9009d8-ebe1-5290-b2d9-b027517667e6 with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e9009d8-ebe1-5290-b2d9-b027517667e6 with scrape type 2
2026-03-29 18:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e9009d8-ebe1-5290-b2d9-b027517667e6, identifier: RU04475
2026-03-29 18:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475
2026-03-29 18:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475
2026-03-29 18:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e9009d8-ebe1-5290-b2d9-b027517667e6 with identifier: RU04475 to the API
2026-03-29 18:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:00:58Z',
'fuel_type': 'diesel',
'id': '4e9009d8-ebe1-5290-b2d9-b027517667e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU04475',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 113428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-19',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2020}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Saving data for RU04475: {'auction_closing_time': 1774882858.0, 'created_time': 1773400305.730523, 'last_price_update_time': 1774809683.158965}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU04475') HTTP/1.1" 204 0
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for CM46932: 0
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for YU99321: 0
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for BS30478: 0
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for GR11096: 2
2026-03-29 18:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-29 18:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6, identifier: GR11096
2026-03-29 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-29 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-29 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096 to the API
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:25:16Z',
'fuel_type': 'petrol',
'id': 'cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR11096',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 76482,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-03',
'seller_name': None,
'title': 'Hyundai i20 1.4 Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Saving data for GR11096: {'auction_closing_time': 1774884316.0, 'created_time': 1773861611.305294, 'last_price_update_time': 1774809683.746938}
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR11096') HTTP/1.1" 204 0
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for VS98384: 0
2026-03-29 18:41:23 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-29 18:41:23 [auto1.de] INFO: Scrape type for BP69696: 2
2026-03-29 18:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-29 18:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with scrape type 2
2026-03-29 18:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b, identifier: BP69696
2026-03-29 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-29 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696
2026-03-29 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b59145b-d2ac-5292-8f2e-a1f9dd99288b with identifier: BP69696 to the API
2026-03-29 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:14:16Z',
'fuel_type': 'petrol',
'id': '0b59145b-d2ac-5292-8f2e-a1f9dd99288b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP69696',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 79789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 220 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Saving data for BP69696: {'auction_closing_time': 1774883656.0, 'created_time': 1774521623.259345, 'last_price_update_time': 1774809684.155077}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP69696') HTTP/1.1" 204 0
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Scrape type for UZ43090: 2
2026-03-29 18:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090
2026-03-29 18:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8ad5bf-a3da-5911-aecd-b55272431f49 with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8ad5bf-a3da-5911-aecd-b55272431f49 with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c8ad5bf-a3da-5911-aecd-b55272431f49, identifier: UZ43090
2026-03-29 18:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090
2026-03-29 18:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090
2026-03-29 18:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c8ad5bf-a3da-5911-aecd-b55272431f49 with identifier: UZ43090 to the API
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:14:42Z',
'fuel_type': 'petrol',
'id': '9c8ad5bf-a3da-5911-aecd-b55272431f49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ43090',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 131865,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-26',
'seller_name': None,
'title': 'Ford B-Max 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2016}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Saving data for UZ43090: {'auction_closing_time': 1774883682.0, 'created_time': 1773383043.548498, 'last_price_update_time': 1774809684.649644}
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ43090') HTTP/1.1" 204 0
2026-03-29 18:41:24 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-29 18:41:24 [auto1.de] INFO: Scrape type for LW30512: 2
2026-03-29 18:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-29 18:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with scrape type 2
2026-03-29 18:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b, identifier: LW30512
2026-03-29 18:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-29 18:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512
2026-03-29 18:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0608d3a7-1169-5bf8-9ee0-2aecb643c36b with identifier: LW30512 to the API
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:47:52Z',
'fuel_type': 'diesel',
'id': '0608d3a7-1169-5bf8-9ee0-2aecb643c36b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW30512',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 92994,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-05',
'seller_name': None,
'title': 'Citroen Jumpy 1.5 Blue-HDi M',
'transmission': 'manual',
'trim': 'M',
'year': 2019}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Saving data for LW30512: {'auction_closing_time': 1774885672.0, 'created_time': 1774521932.563648, 'last_price_update_time': 1774809685.080098}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW30512') HTTP/1.1" 204 0
2026-03-29 18:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Scrape type for CH30601: 2
2026-03-29 18:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601
2026-03-29 18:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c7b747-a3d1-527e-925e-df44f2b3fb23 with scrape type 2
2026-03-29 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c7b747-a3d1-527e-925e-df44f2b3fb23 with scrape type 2
2026-03-29 18:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4c7b747-a3d1-527e-925e-df44f2b3fb23, identifier: CH30601
2026-03-29 18:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601
2026-03-29 18:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601
2026-03-29 18:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4c7b747-a3d1-527e-925e-df44f2b3fb23 with identifier: CH30601 to the API
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:11Z',
'fuel_type': 'petrol',
'id': 'a4c7b747-a3d1-527e-925e-df44f2b3fb23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH30601',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 144756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-08',
'seller_name': None,
'title': 'Opel Astra 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2009}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Saving data for CH30601: {'auction_closing_time': 1774883831.0, 'created_time': 1774636635.286033, 'last_price_update_time': 1774809685.50116}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH30601') HTTP/1.1" 204 0
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Scrape type for GB27132: 2
2026-03-29 18:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-29 18:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08fbb12-8df3-56bc-8412-a06904636da1 with scrape type 2
2026-03-29 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08fbb12-8df3-56bc-8412-a06904636da1 with scrape type 2
2026-03-29 18:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08fbb12-8df3-56bc-8412-a06904636da1, identifier: GB27132
2026-03-29 18:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-29 18:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-29 18:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132 to the API
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:33:31Z',
'fuel_type': 'petrol',
'id': 'f08fbb12-8df3-56bc-8412-a06904636da1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27132',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 67639,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-02',
'seller_name': None,
'title': 'Ford Fiesta 1.5 EcoBoost ST',
'transmission': 'manual',
'trim': 'ST',
'year': 2019}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-29 18:41:25 [auto1.de] INFO: Saving data for GB27132: {'auction_closing_time': 1774884811.0, 'created_time': 1773302926.630431, 'last_price_update_time': 1774809685.971923}
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27132') HTTP/1.1" 204 0
2026-03-29 18:41:25 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-29 18:41:25 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for JR98479: 2
2026-03-29 18:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-29 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbef9642-8ef4-533c-9d0c-89f213793cf7 with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbef9642-8ef4-533c-9d0c-89f213793cf7 with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbef9642-8ef4-533c-9d0c-89f213793cf7, identifier: JR98479
2026-03-29 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-29 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-29 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479 to the API
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:38:44Z',
'fuel_type': 'petrol',
'id': 'cbef9642-8ef4-533c-9d0c-89f213793cf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR98479',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 91269,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-29',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Saving data for JR98479: {'auction_closing_time': 1774885124.0, 'created_time': 1773382837.87717, 'last_price_update_time': 1774809686.416034}
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR98479') HTTP/1.1" 204 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for VZ15565: 2
2026-03-29 18:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-29 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab, identifier: VZ15565
2026-03-29 18:41:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for ZD70727: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for RW15562: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for RX78889: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for FB42809: 0
2026-03-29 18:41:26 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-29 18:41:26 [auto1.de] INFO: Scrape type for AV32823: 2
2026-03-29 18:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-29 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8b3f80-d2ce-575a-a690-2a29462954e4 with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8b3f80-d2ce-575a-a690-2a29462954e4 with scrape type 2
2026-03-29 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8b3f80-d2ce-575a-a690-2a29462954e4, identifier: AV32823
2026-03-29 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-29 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-29 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565 to the API
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:07:42Z',
'fuel_type': 'petrol',
'id': 'abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ15565',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 135645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-09',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Style Viva',
'transmission': 'manual',
'trim': 'Style Viva',
'year': 2012}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Saving data for VZ15565: {'auction_closing_time': 1774883262.0, 'created_time': 1774607966.13937, 'last_price_update_time': 1774809687.066115}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ15565') HTTP/1.1" 204 0
2026-03-29 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-29 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-29 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823 to the API
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:56:12Z',
'fuel_type': 'petrol',
'id': 'ef8b3f80-d2ce-575a-a690-2a29462954e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV32823',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 80531,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Saving data for AV32823: {'auction_closing_time': 1774886172.0, 'created_time': 1773553392.869484, 'last_price_update_time': 1774809687.490764}
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV32823') HTTP/1.1" 204 0
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for NV00892: 0
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for CV84531: 0
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for UF17826: 0
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for ZS44353: 0
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for ZY07029: 2
2026-03-29 18:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-29 18:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d077a248-a8f1-5071-81c9-68e9f53a0bb6 with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d077a248-a8f1-5071-81c9-68e9f53a0bb6 with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d077a248-a8f1-5071-81c9-68e9f53a0bb6, identifier: ZY07029
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-29 18:41:27 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-29 18:41:27 [auto1.de] INFO: Scrape type for YT12990: 2
2026-03-29 18:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-29 18:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33b090c3-7679-5d79-9827-15456f1a02ca with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33b090c3-7679-5d79-9827-15456f1a02ca with scrape type 2
2026-03-29 18:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33b090c3-7679-5d79-9827-15456f1a02ca, identifier: YT12990
2026-03-29 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-29 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-29 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029 to the API
2026-03-29 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 360,
'expiration_date': '2026-03-30T15:19:13Z',
'fuel_type': 'petrol',
'id': 'd077a248-a8f1-5071-81c9-68e9f53a0bb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY07029',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 94990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-13',
'seller_name': None,
'title': 'Porsche Macan GTS',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Saving data for ZY07029: {'auction_closing_time': 1774883953.0, 'created_time': 1773819347.510762, 'last_price_update_time': 1774809688.150681}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY07029') HTTP/1.1" 204 0
2026-03-29 18:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-29 18:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-29 18:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990 to the API
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:14:13Z',
'fuel_type': 'petrol',
'id': '33b090c3-7679-5d79-9827-15456f1a02ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT12990',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 67771,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-31',
'seller_name': None,
'title': 'Suzuki Swift 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Saving data for YT12990: {'auction_closing_time': 1774883653.0, 'created_time': 1774608094.754815, 'last_price_update_time': 1774809688.569606}
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT12990') HTTP/1.1" 204 0
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for KA83953: 2
2026-03-29 18:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-29 18:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e5a093-2934-5d5f-b48d-ce9d9510874d with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e5a093-2934-5d5f-b48d-ce9d9510874d with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41e5a093-2934-5d5f-b48d-ce9d9510874d, identifier: KA83953
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for DD28346: 0
2026-03-29 18:41:28 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-29 18:41:28 [auto1.de] INFO: Scrape type for WU34060: 2
2026-03-29 18:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-29 18:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with scrape type 2
2026-03-29 18:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38, identifier: WU34060
2026-03-29 18:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-29 18:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953
2026-03-29 18:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41e5a093-2934-5d5f-b48d-ce9d9510874d with identifier: KA83953 to the API
2026-03-29 18:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:59:08Z',
'fuel_type': 'petrol',
'id': '41e5a093-2934-5d5f-b48d-ce9d9510874d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA83953',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 226093,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-18',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Saving data for KA83953: {'auction_closing_time': 1774886348.0, 'created_time': 1773381403.085771, 'last_price_update_time': 1774809689.123006}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA83953') HTTP/1.1" 204 0
2026-03-29 18:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-29 18:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-29 18:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060 to the API
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:31:07Z',
'fuel_type': 'petrol',
'id': '5fa9eeca-3502-5a6f-80ae-74520ebbbe38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU34060',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 201041,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-28',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI Style Copa',
'transmission': 'manual',
'trim': 'Style Copa',
'year': 2011}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Saving data for WU34060: {'auction_closing_time': 1774884667.0, 'created_time': 1773812129.92023, 'last_price_update_time': 1774809689.570966}
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU34060') HTTP/1.1" 204 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for NB97805: 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for XD89320: 2
2026-03-29 18:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-29 18:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f67830-93b5-5be8-a012-51868dbdf652 with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f67830-93b5-5be8-a012-51868dbdf652 with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2f67830-93b5-5be8-a012-51868dbdf652, identifier: XD89320
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for MT59111: 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for HV33102: 0
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-29 18:41:29 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-29 18:41:29 [auto1.de] INFO: Scrape type for VX14305: 2
2026-03-29 18:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-29 18:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f39087bf-9e2e-5b16-809a-b3173873d7fe with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f39087bf-9e2e-5b16-809a-b3173873d7fe with scrape type 2
2026-03-29 18:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f39087bf-9e2e-5b16-809a-b3173873d7fe, identifier: VX14305
2026-03-29 18:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-29 18:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-29 18:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320 to the API
2026-03-29 18:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:19:35Z',
'fuel_type': 'petrol',
'id': 'd2f67830-93b5-5be8-a012-51868dbdf652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD89320',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 117789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-11',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2014}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-29 18:41:30 [auto1.de] INFO: Saving data for XD89320: {'auction_closing_time': 1774883975.0, 'created_time': 1773401439.753579, 'last_price_update_time': 1774809690.458219}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD89320') HTTP/1.1" 204 0
2026-03-29 18:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-29 18:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-29 18:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305 to the API
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:33:18Z',
'fuel_type': 'petrol',
'id': 'f39087bf-9e2e-5b16-809a-b3173873d7fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX14305',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 80422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-19',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2023}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-29 18:41:30 [auto1.de] INFO: Saving data for VX14305: {'auction_closing_time': 1774884798.0, 'created_time': 1773381502.143565, 'last_price_update_time': 1774809690.961935}
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX14305') HTTP/1.1" 204 0
2026-03-29 18:41:30 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-29 18:41:30 [auto1.de] INFO: Scrape type for XA52388: 2
2026-03-29 18:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-29 18:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c730986c-403f-50a4-a5fc-c49eb0d394fb with scrape type 2
2026-03-29 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c730986c-403f-50a4-a5fc-c49eb0d394fb with scrape type 2
2026-03-29 18:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c730986c-403f-50a4-a5fc-c49eb0d394fb, identifier: XA52388
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-29 18:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-29 18:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388
2026-03-29 18:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c730986c-403f-50a4-a5fc-c49eb0d394fb with identifier: XA52388 to the API
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:56:31Z',
'fuel_type': 'petrol',
'id': 'c730986c-403f-50a4-a5fc-c49eb0d394fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA52388',
'listing': 'auction',
'make': 'BMW',
'model': 'X2',
'odometer': 90767,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-20',
'seller_name': None,
'title': 'BMW X2 xDrive 20i M Sport X',
'transmission': 'automatic',
'trim': 'M Sport X',
'year': 2018}
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Saving data for XA52388: {'auction_closing_time': 1774886191.0, 'created_time': 1773429443.888774, 'last_price_update_time': 1774809691.849055}
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA52388') HTTP/1.1" 204 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for AA38517: 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for BZ60217: 0
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-29 18:41:31 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-29 18:41:31 [auto1.de] INFO: Scrape type for LN58071: 2
2026-03-29 18:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-29 18:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a14ae77a-a810-5a6f-a38f-55123f125b3a with scrape type 2
2026-03-29 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a14ae77a-a810-5a6f-a38f-55123f125b3a with scrape type 2
2026-03-29 18:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a14ae77a-a810-5a6f-a38f-55123f125b3a, identifier: LN58071
2026-03-29 18:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-29 18:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071
2026-03-29 18:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a14ae77a-a810-5a6f-a38f-55123f125b3a with identifier: LN58071 to the API
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:29Z',
'fuel_type': 'diesel',
'id': 'a14ae77a-a810-5a6f-a38f-55123f125b3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN58071',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 132952,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-06',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2022}
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Saving data for LN58071: {'auction_closing_time': 1774885349.0, 'created_time': 1773381909.19982, 'last_price_update_time': 1774809692.317002}
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN58071') HTTP/1.1" 204 0
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-29 18:41:32 [auto1.de] INFO: Scrape type for BD46064: 0
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-29 18:41:32 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-29 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:33 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for JP54184: 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for NG89372: 0
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for AW80903: 2
2026-03-29 18:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903
2026-03-29 18:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with scrape type 2
2026-03-29 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with scrape type 2
2026-03-29 18:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd, identifier: AW80903
2026-03-29 18:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903
2026-03-29 18:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903
2026-03-29 18:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd with identifier: AW80903 to the API
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:13:59Z',
'fuel_type': 'petrol',
'id': '56f0e03a-fd30-524b-9cbc-a5fbf0d5eabd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW80903',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 133979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-31',
'seller_name': None,
'title': 'Hyundai ix35 1.6 FIFA World Cup Edition 2WD',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition 2WD',
'year': 2015}
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Saving data for AW80903: {'auction_closing_time': 1774883639.0, 'created_time': 1773380884.792966, 'last_price_update_time': 1774809693.768938}
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW80903') HTTP/1.1" 204 0
2026-03-29 18:41:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-29 18:41:33 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-29 18:41:33 [auto1.de] INFO: Scrape type for FB84476: 2
2026-03-29 18:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-29 18:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769549db-d892-59e7-93d8-e495c48928ce with scrape type 2
2026-03-29 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 769549db-d892-59e7-93d8-e495c48928ce with scrape type 2
2026-03-29 18:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 769549db-d892-59e7-93d8-e495c48928ce, identifier: FB84476
2026-03-29 18:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-29 18:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-29 18:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476 to the API
2026-03-29 18:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:04:06Z',
'fuel_type': 'petrol',
'id': '769549db-d892-59e7-93d8-e495c48928ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB84476',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 144759,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-08',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-29 18:41:35 [auto1.de] INFO: Saving data for FB84476: {'auction_closing_time': 1774883046.0, 'created_time': 1773341611.653298, 'last_price_update_time': 1774809695.944577}
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB84476') HTTP/1.1" 204 0
2026-03-29 18:41:35 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-29 18:41:35 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-29 18:41:35 [auto1.de] INFO: Scrape type for CK11382: 2
2026-03-29 18:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-29 18:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with scrape type 2
2026-03-29 18:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with scrape type 2
2026-03-29 18:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749, identifier: CK11382
2026-03-29 18:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-29 18:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-29 18:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382 to the API
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:58:11Z',
'fuel_type': 'diesel',
'id': '8a0d12bf-fe4a-5afa-b364-f03b4fc1f749',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK11382',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 216450,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-30',
'seller_name': None,
'title': 'Renault Megane 1.9 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2011}
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Saving data for CK11382: {'auction_closing_time': 1774886291.0, 'created_time': 1773429299.121517, 'last_price_update_time': 1774809696.425819}
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK11382') HTTP/1.1" 204 0
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-29 18:41:36 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-29 18:41:36 [auto1.de] INFO: Scrape type for VZ83010: 2
2026-03-29 18:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-29 18:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf64692-57e2-53f0-ad58-a325f2b580e1 with scrape type 2
2026-03-29 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf64692-57e2-53f0-ad58-a325f2b580e1 with scrape type 2
2026-03-29 18:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bf64692-57e2-53f0-ad58-a325f2b580e1, identifier: VZ83010
2026-03-29 18:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-29 18:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-29 18:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010 to the API
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:48:52Z',
'fuel_type': 'petrol',
'id': '0bf64692-57e2-53f0-ad58-a325f2b580e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ83010',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 38799,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-05',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2024}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Saving data for VZ83010: {'auction_closing_time': 1774885732.0, 'created_time': 1773402383.542394, 'last_price_update_time': 1774809697.031539}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ83010') HTTP/1.1" 204 0
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Scrape type for VN54723: 2
2026-03-29 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-29 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 476b3956-3a5e-5b10-945d-c0e3d5343e6b with scrape type 2
2026-03-29 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 476b3956-3a5e-5b10-945d-c0e3d5343e6b with scrape type 2
2026-03-29 18:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 476b3956-3a5e-5b10-945d-c0e3d5343e6b, identifier: VN54723
2026-03-29 18:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-29 18:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-29 18:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723 to the API
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:47:02Z',
'fuel_type': 'diesel',
'id': '476b3956-3a5e-5b10-945d-c0e3d5343e6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN54723',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 60946,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-05',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 HDi L2 Multispace Selection',
'transmission': 'automatic',
'trim': 'L2 Multispace Selection',
'year': 2015}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Saving data for VN54723: {'auction_closing_time': 1774885622.0, 'created_time': 1773304582.772322, 'last_price_update_time': 1774809697.461698}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN54723') HTTP/1.1" 204 0
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Scrape type for MC98877: 0
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Scrape type for NH53597: 2
2026-03-29 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-29 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with scrape type 2
2026-03-29 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with scrape type 2
2026-03-29 18:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f0b80de-9547-533f-a1a7-ce853cabc5d5, identifier: NH53597
2026-03-29 18:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-29 18:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597
2026-03-29 18:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f0b80de-9547-533f-a1a7-ce853cabc5d5 with identifier: NH53597 to the API
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:58:29Z',
'fuel_type': 'diesel',
'id': '4f0b80de-9547-533f-a1a7-ce853cabc5d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH53597',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 155788,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-01',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-29 18:41:37 [auto1.de] INFO: Saving data for NH53597: {'auction_closing_time': 1774886309.0, 'created_time': 1774521889.511364, 'last_price_update_time': 1774809697.869799}
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH53597') HTTP/1.1" 204 0
2026-03-29 18:41:37 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-29 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for PA91230: 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for MC93517: 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for KM30220: 2
2026-03-29 18:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-29 18:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4083ecd1-3298-5b57-950f-261d48ab49cf with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4083ecd1-3298-5b57-950f-261d48ab49cf with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4083ecd1-3298-5b57-950f-261d48ab49cf, identifier: KM30220
2026-03-29 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-29 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-29 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220 to the API
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:07:07Z',
'fuel_type': 'petrol',
'id': '4083ecd1-3298-5b57-950f-261d48ab49cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM30220',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 243376,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-16',
'seller_name': None,
'title': 'Audi A1 1.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Saving data for KM30220: {'auction_closing_time': 1774883227.0, 'created_time': 1773341525.447016, 'last_price_update_time': 1774809698.491418}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM30220') HTTP/1.1" 204 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for EP96455: 2
2026-03-29 18:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455
2026-03-29 18:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dfc44eb-76c2-5650-aca6-4143c5f63da7, identifier: EP96455
2026-03-29 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455
2026-03-29 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455
2026-03-29 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dfc44eb-76c2-5650-aca6-4143c5f63da7 with identifier: EP96455 to the API
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:43:39Z',
'fuel_type': 'petrol',
'id': '6dfc44eb-76c2-5650-aca6-4143c5f63da7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP96455',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 168141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-10',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2011}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Saving data for EP96455: {'auction_closing_time': 1774885419.0, 'created_time': 1774033621.58239, 'last_price_update_time': 1774809698.917051}
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP96455') HTTP/1.1" 204 0
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-29 18:41:38 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-29 18:41:38 [auto1.de] INFO: Scrape type for BE80399: 2
2026-03-29 18:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-29 18:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d641f77-047a-55f1-a7f1-71533fde03ad with scrape type 2
2026-03-29 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d641f77-047a-55f1-a7f1-71533fde03ad with scrape type 2
2026-03-29 18:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d641f77-047a-55f1-a7f1-71533fde03ad, identifier: BE80399
2026-03-29 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-29 18:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399
2026-03-29 18:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d641f77-047a-55f1-a7f1-71533fde03ad with identifier: BE80399 to the API
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:24:29Z',
'fuel_type': 'petrol',
'id': '0d641f77-047a-55f1-a7f1-71533fde03ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE80399',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 63237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-04-19',
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Argento',
'transmission': 'manual',
'trim': 'Argento',
'year': 2004}
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Saving data for BE80399: {'auction_closing_time': 1774884269.0, 'created_time': 1774521607.137808, 'last_price_update_time': 1774809699.325878}
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE80399') HTTP/1.1" 204 0
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for BC65369: 0
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for VS51325: 0
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for CM37211: 0
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for AM68343: 0
2026-03-29 18:41:39 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for SM38981: 0
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-29 18:41:39 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Scrape type for WD52714: 2
2026-03-29 18:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-29 18:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541348c9-84cf-5aab-b956-6ff98c877dbc with scrape type 2
2026-03-29 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541348c9-84cf-5aab-b956-6ff98c877dbc with scrape type 2
2026-03-29 18:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541348c9-84cf-5aab-b956-6ff98c877dbc, identifier: WD52714
2026-03-29 18:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-29 18:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-29 18:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714 to the API
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:14:58Z',
'fuel_type': 'petrol',
'id': '541348c9-84cf-5aab-b956-6ff98c877dbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD52714',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 115888,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-20',
'seller_name': None,
'title': 'BMW X5 xDrive 50i',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-29 18:41:39 [auto1.de] INFO: Saving data for WD52714: {'auction_closing_time': 1774883698.0, 'created_time': 1774608156.661404, 'last_price_update_time': 1774809699.997446}
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD52714') HTTP/1.1" 204 0
2026-03-29 18:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Scrape type for PS74193: 0
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Scrape type for JE50334: 0
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Scrape type for ZK10618: 0
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Scrape type for YA26169: 2
2026-03-29 18:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-29 18:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef283e63-9dec-5dd6-a117-903b00f9602c with scrape type 2
2026-03-29 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef283e63-9dec-5dd6-a117-903b00f9602c with scrape type 2
2026-03-29 18:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef283e63-9dec-5dd6-a117-903b00f9602c, identifier: YA26169
2026-03-29 18:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-29 18:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-29 18:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169 to the API
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:29Z',
'fuel_type': 'petrol',
'id': 'ef283e63-9dec-5dd6-a117-903b00f9602c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA26169',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 54778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-09',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2022}
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Saving data for YA26169: {'auction_closing_time': 1774884989.0, 'created_time': 1773401405.254514, 'last_price_update_time': 1774809700.588958}
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA26169') HTTP/1.1" 204 0
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-29 18:41:40 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Scrape type for NX98723: 2
2026-03-29 18:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-29 18:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd45d8f3-fc64-5cd6-856d-506911708464 with scrape type 2
2026-03-29 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd45d8f3-fc64-5cd6-856d-506911708464 with scrape type 2
2026-03-29 18:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd45d8f3-fc64-5cd6-856d-506911708464, identifier: NX98723
2026-03-29 18:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-29 18:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723
2026-03-29 18:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd45d8f3-fc64-5cd6-856d-506911708464 with identifier: NX98723 to the API
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:17:38Z',
'fuel_type': 'diesel',
'id': 'cd45d8f3-fc64-5cd6-856d-506911708464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX98723',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 168500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-29 18:41:40 [auto1.de] INFO: Saving data for NX98723: {'auction_closing_time': 1774883858.0, 'created_time': 1774522246.687834, 'last_price_update_time': 1774809700.997426}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX98723') HTTP/1.1" 204 0
2026-03-29 18:41:41 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Scrape type for DE97424: 2
2026-03-29 18:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-29 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3606559e-1b44-59b2-9815-d525fe678338 with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3606559e-1b44-59b2-9815-d525fe678338 with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3606559e-1b44-59b2-9815-d525fe678338, identifier: DE97424
2026-03-29 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-29 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-29 18:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424 to the API
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:47:20Z',
'fuel_type': 'diesel',
'id': '3606559e-1b44-59b2-9815-d525fe678338',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE97424',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 225783,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Life BlueMotion',
'transmission': 'manual',
'trim': 'Life BlueMotion',
'year': 2013}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Saving data for DE97424: {'auction_closing_time': 1774885640.0, 'created_time': 1773137287.788719, 'last_price_update_time': 1774809701.463824}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE97424') HTTP/1.1" 204 0
2026-03-29 18:41:41 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-29 18:41:41 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Scrape type for VY28868: 2
2026-03-29 18:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-29 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32d40a9-15fa-500c-b0f4-60221c3e94a7 with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32d40a9-15fa-500c-b0f4-60221c3e94a7 with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c32d40a9-15fa-500c-b0f4-60221c3e94a7, identifier: VY28868
2026-03-29 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-29 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-29 18:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868 to the API
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:42:24Z',
'fuel_type': 'petrol',
'id': 'c32d40a9-15fa-500c-b0f4-60221c3e94a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY28868',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 64405,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-18',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
'transmission': 'automatic',
'trim': 'GTI Clubsport',
'year': 2021}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Saving data for VY28868: {'auction_closing_time': 1774885344.0, 'created_time': 1773308350.783117, 'last_price_update_time': 1774809701.933481}
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY28868') HTTP/1.1" 204 0
2026-03-29 18:41:41 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-29 18:41:41 [auto1.de] INFO: Scrape type for XN16480: 2
2026-03-29 18:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-29 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04305936-6e41-50fa-9e9f-7d21f1db7b3d with scrape type 2
2026-03-29 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04305936-6e41-50fa-9e9f-7d21f1db7b3d with scrape type 2
2026-03-29 18:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04305936-6e41-50fa-9e9f-7d21f1db7b3d, identifier: XN16480
2026-03-29 18:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-29 18:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-29 18:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480 to the API
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:26:31Z',
'fuel_type': 'petrol',
'id': '04305936-6e41-50fa-9e9f-7d21f1db7b3d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN16480',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 169882,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-01',
'seller_name': None,
'title': 'Audi A3 Sportback 1.2 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2011}
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Saving data for XN16480: {'auction_closing_time': 1774884391.0, 'created_time': 1774350519.263454, 'last_price_update_time': 1774809702.408311}
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN16480') HTTP/1.1" 204 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for CD67065: 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for EH58090: 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for SS59240: 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for BW78905: 0
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-29 18:41:42 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-29 18:41:42 [auto1.de] INFO: Scrape type for LV93529: 2
2026-03-29 18:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-29 18:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43184f3f-f371-5419-a62d-32e3bc25f1bb with scrape type 2
2026-03-29 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43184f3f-f371-5419-a62d-32e3bc25f1bb with scrape type 2
2026-03-29 18:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43184f3f-f371-5419-a62d-32e3bc25f1bb, identifier: LV93529
2026-03-29 18:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-29 18:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529
2026-03-29 18:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43184f3f-f371-5419-a62d-32e3bc25f1bb with identifier: LV93529 to the API
2026-03-29 18:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:14:59Z',
'fuel_type': 'petrol',
'id': '43184f3f-f371-5419-a62d-32e3bc25f1bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV93529',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLC-Klasse',
'odometer': 44203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'Mercedes-Benz SLC-Klasse SLC 300 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-29 18:41:43 [auto1.de] INFO: Saving data for LV93529: {'auction_closing_time': 1774883699.0, 'created_time': 1774521671.36499, 'last_price_update_time': 1774809703.874959}
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV93529') HTTP/1.1" 204 0
2026-03-29 18:41:43 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-29 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for FP27450: 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for RV26500: 2
2026-03-29 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-29 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f8f6a2-a744-5295-96bd-003625d9e42d with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3f8f6a2-a744-5295-96bd-003625d9e42d with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3f8f6a2-a744-5295-96bd-003625d9e42d, identifier: RV26500
2026-03-29 18:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-29 18:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-29 18:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500 to the API
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:27Z',
'fuel_type': 'diesel',
'id': 'd3f8f6a2-a744-5295-96bd-003625d9e42d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV26500',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 66723,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-25',
'seller_name': None,
'title': 'BMW 2er 218d Active Tourer Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2023}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Saving data for RV26500: {'auction_closing_time': 1774886247.0, 'created_time': 1774608239.108031, 'last_price_update_time': 1774809704.477404}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV26500') HTTP/1.1" 204 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for LB25198: 2
2026-03-29 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-29 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df76649b-e3e6-5f74-81f2-16f1dee725e3 with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df76649b-e3e6-5f74-81f2-16f1dee725e3 with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df76649b-e3e6-5f74-81f2-16f1dee725e3, identifier: LB25198
2026-03-29 18:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-29 18:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-29 18:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198 to the API
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 435,
'expiration_date': '2026-03-30T15:52:28Z',
'fuel_type': 'diesel',
'id': 'df76649b-e3e6-5f74-81f2-16f1dee725e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB25198',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ7',
'odometer': 158917,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-22',
'seller_name': None,
'title': 'Audi SQ7 4.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Saving data for LB25198: {'auction_closing_time': 1774885948.0, 'created_time': 1773861387.901099, 'last_price_update_time': 1774809704.929943}
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB25198') HTTP/1.1" 204 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for DN02562: 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for TV01596: 0
2026-03-29 18:41:44 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-29 18:41:44 [auto1.de] INFO: Scrape type for SU94182: 2
2026-03-29 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-29 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb26360-181a-57ec-8194-f333b80c7990 with scrape type 2
2026-03-29 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb26360-181a-57ec-8194-f333b80c7990 with scrape type 2
2026-03-29 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acb26360-181a-57ec-8194-f333b80c7990, identifier: SU94182
2026-03-29 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-29 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-29 18:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182 to the API
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:23Z',
'fuel_type': 'petrol',
'id': 'acb26360-181a-57ec-8194-f333b80c7990',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU94182',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 91803,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-08',
'seller_name': None,
'title': 'Audi Q3 35 TFSI Mild-Hybrid ACT S line',
'transmission': 'automatic',
'trim': 'ACT S line',
'year': 2020}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Saving data for SU94182: {'auction_closing_time': 1774884863.0, 'created_time': 1774293511.379683, 'last_price_update_time': 1774809705.458643}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU94182') HTTP/1.1" 204 0
2026-03-29 18:41:45 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Scrape type for TJ83975: 2
2026-03-29 18:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-29 18:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with scrape type 2
2026-03-29 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with scrape type 2
2026-03-29 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6e319ce-b6fd-5a9f-9e4e-9272ce540652, identifier: TJ83975
2026-03-29 18:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-29 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-29 18:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975 to the API
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:25:23Z',
'fuel_type': 'diesel',
'id': 'e6e319ce-b6fd-5a9f-9e4e-9272ce540652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ83975',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Cruze',
'odometer': 212091,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-21',
'seller_name': None,
'title': 'Chevrolet Cruze 2.0 Diesel LTZ',
'transmission': 'automatic',
'trim': 'LTZ',
'year': 2013}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-29 18:41:45 [auto1.de] INFO: Saving data for TJ83975: {'auction_closing_time': 1774884323.0, 'created_time': 1774291420.187291, 'last_price_update_time': 1774809705.962641}
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ83975') HTTP/1.1" 204 0
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Scrape type for MU97238: 0
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Scrape type for NA32054: 2
2026-03-29 18:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054
2026-03-29 18:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e04dfc-7764-5782-a9ef-362e87ea85dd with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60e04dfc-7764-5782-a9ef-362e87ea85dd with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60e04dfc-7764-5782-a9ef-362e87ea85dd, identifier: NA32054
2026-03-29 18:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054
2026-03-29 18:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054
2026-03-29 18:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60e04dfc-7764-5782-a9ef-362e87ea85dd with identifier: NA32054 to the API
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:40:37Z',
'fuel_type': 'hybrid',
'id': '60e04dfc-7764-5782-a9ef-362e87ea85dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA32054',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 172475,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-17',
'seller_name': None,
'title': 'Audi A6 50 TFSIe quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2022}
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Saving data for NA32054: {'auction_closing_time': 1774885237.0, 'created_time': 1773917501.72531, 'last_price_update_time': 1774809706.534346}
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA32054') HTTP/1.1" 204 0
2026-03-29 18:41:46 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Scrape type for YT16103: 0
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-29 18:41:46 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-29 18:41:46 [auto1.de] INFO: Scrape type for DW51780: 2
2026-03-29 18:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-29 18:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c653339c-9f41-5a46-b656-52162bcf9398 with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c653339c-9f41-5a46-b656-52162bcf9398 with scrape type 2
2026-03-29 18:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c653339c-9f41-5a46-b656-52162bcf9398, identifier: DW51780
2026-03-29 18:41:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-29 18:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-29 18:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780 to the API
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:41:43Z',
'fuel_type': 'diesel',
'id': 'c653339c-9f41-5a46-b656-52162bcf9398',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW51780',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 266330,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-28',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2012}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Saving data for DW51780: {'auction_closing_time': 1774885303.0, 'created_time': 1774293394.095364, 'last_price_update_time': 1774809707.017043}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW51780') HTTP/1.1" 204 0
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Scrape type for BJ70582: 0
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Scrape type for JB08013: 2
2026-03-29 18:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-29 18:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e6d0ad-e90b-5313-b0d3-eac18c29479b with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e6d0ad-e90b-5313-b0d3-eac18c29479b with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40e6d0ad-e90b-5313-b0d3-eac18c29479b, identifier: JB08013
2026-03-29 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-29 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-29 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013 to the API
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:08:02Z',
'fuel_type': 'petrol',
'id': '40e6d0ad-e90b-5313-b0d3-eac18c29479b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB08013',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 131935,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-26',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
'transmission': 'automatic',
'trim': 'Innovation',
'year': 2018}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Saving data for JB08013: {'auction_closing_time': 1774883282.0, 'created_time': 1773401925.625186, 'last_price_update_time': 1774809707.514685}
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB08013') HTTP/1.1" 204 0
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Scrape type for RC44114: 0
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Scrape type for AE57502: 0
2026-03-29 18:41:47 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-29 18:41:47 [auto1.de] INFO: Scrape type for HC05500: 2
2026-03-29 18:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500
2026-03-29 18:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with scrape type 2
2026-03-29 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee, identifier: HC05500
2026-03-29 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500
2026-03-29 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500
2026-03-29 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee with identifier: HC05500 to the API
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:59:59Z',
'fuel_type': 'diesel',
'id': '91a0c21b-1215-5f7b-a4d7-5cd7a18b59ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC05500',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 136556,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-27',
'seller_name': None,
'title': 'BMW 5er 520d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2017}
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Saving data for HC05500: {'auction_closing_time': 1774886399.0, 'created_time': 1773831130.041469, 'last_price_update_time': 1774809708.079758}
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC05500') HTTP/1.1" 204 0
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE06488%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Scrape type for KE06488: 2
2026-03-29 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488
2026-03-29 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d7206d6-0f40-539f-89c6-28236583b347 with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d7206d6-0f40-539f-89c6-28236583b347 with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d7206d6-0f40-539f-89c6-28236583b347, identifier: KE06488
2026-03-29 18:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488
2026-03-29 18:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488
2026-03-29 18:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d7206d6-0f40-539f-89c6-28236583b347 with identifier: KE06488 to the API
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:29:11Z',
'fuel_type': 'diesel',
'id': '3d7206d6-0f40-539f-89c6-28236583b347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE06488',
'listing': 'auction',
'make': 'Kia',
'model': 'Optima',
'odometer': 170373,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-03',
'seller_name': None,
'title': 'Kia Optima 1.7 CRDi Spirit',
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2014}
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE06488%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Saving data for KE06488: {'auction_closing_time': 1774884551.0, 'created_time': 1774723151.176313, 'last_price_update_time': 1774809708.52903}
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE06488') HTTP/1.1" 204 0
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-29 18:41:48 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-29 18:41:48 [auto1.de] INFO: Scrape type for GA86041: 2
2026-03-29 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-29 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f530195-018f-5dca-b409-d7a978557dfb with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f530195-018f-5dca-b409-d7a978557dfb with scrape type 2
2026-03-29 18:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f530195-018f-5dca-b409-d7a978557dfb, identifier: GA86041
2026-03-29 18:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-29 18:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-29 18:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041 to the API
2026-03-29 18:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:58:10Z',
'fuel_type': 'petrol',
'id': '7f530195-018f-5dca-b409-d7a978557dfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA86041',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 164805,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-27',
'seller_name': None,
'title': 'Skoda Octavia 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-29 18:41:50 [auto1.de] INFO: Saving data for GA86041: {'auction_closing_time': 1774886290.0, 'created_time': 1773306910.76262, 'last_price_update_time': 1774809710.932173}
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA86041') HTTP/1.1" 204 0
2026-03-29 18:41:50 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-29 18:41:50 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-29 18:41:50 [auto1.de] INFO: Scrape type for SU61840: 2
2026-03-29 18:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-29 18:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d29eef2-1aad-5d60-81dd-311508dc3855 with scrape type 2
2026-03-29 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d29eef2-1aad-5d60-81dd-311508dc3855 with scrape type 2
2026-03-29 18:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d29eef2-1aad-5d60-81dd-311508dc3855, identifier: SU61840
2026-03-29 18:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-29 18:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-29 18:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840 to the API
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:12:42Z',
'fuel_type': 'petrol',
'id': '3d29eef2-1aad-5d60-81dd-311508dc3855',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU61840',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 49133,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-07',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-29 18:41:51 [auto1.de] INFO: Saving data for SU61840: {'auction_closing_time': 1774883562.0, 'created_time': 1774608696.133629, 'last_price_update_time': 1774809711.449343}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU61840') HTTP/1.1" 204 0
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-29 18:41:51 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-29 18:41:51 [auto1.de] INFO: Scrape type for CV30078: 2
2026-03-29 18:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078
2026-03-29 18:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fa6268-7311-50aa-9d3f-9d628a431f17 with scrape type 2
2026-03-29 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80fa6268-7311-50aa-9d3f-9d628a431f17 with scrape type 2
2026-03-29 18:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80fa6268-7311-50aa-9d3f-9d628a431f17, identifier: CV30078
2026-03-29 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078
2026-03-29 18:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078
2026-03-29 18:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80fa6268-7311-50aa-9d3f-9d628a431f17 with identifier: CV30078 to the API
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T16:00:00Z',
'fuel_type': 'diesel',
'id': '80fa6268-7311-50aa-9d3f-9d628a431f17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV30078',
'listing': 'auction',
'make': 'BMW',
'model': 'X6',
'odometer': 132529,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-27',
'seller_name': None,
'title': 'BMW X6 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-29 18:41:51 [auto1.de] INFO: Saving data for CV30078: {'auction_closing_time': 1774886400.0, 'created_time': 1773132463.164837, 'last_price_update_time': 1774809711.98318}
2026-03-29 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV30078') HTTP/1.1" 204 0
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for BY91581: 2
2026-03-29 18:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581
2026-03-29 18:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec98b7a0-9502-5daf-9c00-2836f3add16a with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec98b7a0-9502-5daf-9c00-2836f3add16a with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec98b7a0-9502-5daf-9c00-2836f3add16a, identifier: BY91581
2026-03-29 18:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581
2026-03-29 18:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581
2026-03-29 18:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec98b7a0-9502-5daf-9c00-2836f3add16a with identifier: BY91581 to the API
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:07:34Z',
'fuel_type': 'petrol',
'id': 'ec98b7a0-9502-5daf-9c00-2836f3add16a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY91581',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 179965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-19',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Allstar',
'transmission': 'manual',
'trim': 'Allstar',
'year': 2016}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Saving data for BY91581: {'auction_closing_time': 1774883254.0, 'created_time': 1774636541.100275, 'last_price_update_time': 1774809712.384187}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY91581') HTTP/1.1" 204 0
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for RD90808: 0
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for LR33805: 0
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for GK55952: 2
2026-03-29 18:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-29 18:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084bb1bc-1db1-5c53-913d-6300f03782cd with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 084bb1bc-1db1-5c53-913d-6300f03782cd with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 084bb1bc-1db1-5c53-913d-6300f03782cd, identifier: GK55952
2026-03-29 18:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-29 18:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-29 18:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952 to the API
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:16:55Z',
'fuel_type': 'petrol',
'id': '084bb1bc-1db1-5c53-913d-6300f03782cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK55952',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 142994,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-26',
'seller_name': None,
'title': 'Smart fortwo 1.0 Turbo BRABUS BRABUS Xclusive',
'transmission': 'automatic',
'trim': 'BRABUS BRABUS Xclusive',
'year': 2014}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Saving data for GK55952: {'auction_closing_time': 1774883815.0, 'created_time': 1773859000.563124, 'last_price_update_time': 1774809712.939364}
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK55952') HTTP/1.1" 204 0
2026-03-29 18:41:52 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 6740 | hits on page: 40
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-29 18:41:52 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-29 18:41:52 [auto1.de] INFO: Scrape type for GY49475: 2
2026-03-29 18:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-29 18:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with scrape type 2
2026-03-29 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae, identifier: GY49475
2026-03-29 18:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-29 18:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475
2026-03-29 18:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dca7d81a-3126-5f52-bcf8-175ccbb1e6ae with identifier: GY49475 to the API
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:17:01Z',
'fuel_type': 'petrol',
'id': 'dca7d81a-3126-5f52-bcf8-175ccbb1e6ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY49475',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 201796,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-07-15',
'seller_name': None,
'title': 'Honda Civic 1.4 LS',
'transmission': 'manual',
'trim': 'LS',
'year': 2001}
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Saving data for GY49475: {'auction_closing_time': 1774883821.0, 'created_time': 1774002727.549319, 'last_price_update_time': 1774809713.351151}
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY49475') HTTP/1.1" 204 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for KX83133: 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for CG01662: 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for TZ90006: 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for EA89472: 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for WY51014: 0
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: US71241
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for CR70146: 2
2026-03-29 18:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-29 18:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53f36514-15a5-5ecd-b3ef-379629d48d5a with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53f36514-15a5-5ecd-b3ef-379629d48d5a with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53f36514-15a5-5ecd-b3ef-379629d48d5a, identifier: CR70146
2026-03-29 18:41:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:41:53 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-29 18:41:53 [auto1.de] INFO: Scrape type for DK64287: 2
2026-03-29 18:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-29 18:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with scrape type 2
2026-03-29 18:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d0ae62d-2e3f-5e99-891c-05aaaed55274, identifier: DK64287
2026-03-29 18:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-29 18:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-29 18:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146 to the API
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:35:03Z',
'fuel_type': 'petrol',
'id': '53f36514-15a5-5ecd-b3ef-379629d48d5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR70146',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 68596,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-07',
'seller_name': None,
'title': 'Fiat Panda 1.2 MyLive',
'transmission': 'manual',
'trim': 'MyLive',
'year': 2011}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Saving data for CR70146: {'auction_closing_time': 1774884903.0, 'created_time': 1774608336.591064, 'last_price_update_time': 1774809714.10087}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR70146') HTTP/1.1" 204 0
2026-03-29 18:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-29 18:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-29 18:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287 to the API
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:15:49Z',
'fuel_type': 'diesel',
'id': '9d0ae62d-2e3f-5e99-891c-05aaaed55274',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK64287',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 155870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-26',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition 4x4',
'transmission': 'automatic',
'trim': 'Ambition 4x4',
'year': 2017}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Saving data for DK64287: {'auction_closing_time': 1774883749.0, 'created_time': 1773775604.571182, 'last_price_update_time': 1774809714.55469}
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK64287') HTTP/1.1" 204 0
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for PV05136: 2
2026-03-29 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-29 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bd4e256-9c3d-5f18-81f3-082a8445b94c, identifier: PV05136
2026-03-29 18:41:54 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-29 18:41:54 [auto1.de] INFO: Scrape type for YT00833: 2
2026-03-29 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833
2026-03-29 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with scrape type 2
2026-03-29 18:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 745f1ea0-4904-5b8f-be6c-a8930ebdc851, identifier: YT00833
2026-03-29 18:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-29 18:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-29 18:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136 to the API
2026-03-29 18:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:38:42Z',
'fuel_type': 'diesel',
'id': '1bd4e256-9c3d-5f18-81f3-082a8445b94c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV05136',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris',
'odometer': 193793,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-11',
'seller_name': None,
'title': 'Toyota Auris 1.4 Turbodiesel Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2008}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Saving data for PV05136: {'auction_closing_time': 1774885122.0, 'created_time': 1774608553.594502, 'last_price_update_time': 1774809715.136942}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV05136') HTTP/1.1" 204 0
2026-03-29 18:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833
2026-03-29 18:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833
2026-03-29 18:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 745f1ea0-4904-5b8f-be6c-a8930ebdc851 with identifier: YT00833 to the API
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:34:03Z',
'fuel_type': 'petrol',
'id': '745f1ea0-4904-5b8f-be6c-a8930ebdc851',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT00833',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 76620,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2017}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Saving data for YT00833: {'auction_closing_time': 1774884843.0, 'created_time': 1773308238.765331, 'last_price_update_time': 1774809715.421464}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT00833') HTTP/1.1" 204 0
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Scrape type for ZF08436: 0
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Scrape type for NB27251: 2
2026-03-29 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-29 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e49f55e-218f-56a0-bab7-cb2796f14128 with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e49f55e-218f-56a0-bab7-cb2796f14128 with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e49f55e-218f-56a0-bab7-cb2796f14128, identifier: NB27251
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-29 18:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-29 18:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-29 18:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251 to the API
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 398,
'expiration_date': '2026-03-30T15:16:39Z',
'fuel_type': 'petrol',
'id': '3e49f55e-218f-56a0-bab7-cb2796f14128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB27251',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 18642,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-22',
'seller_name': None,
'title': 'BMW X3 M50 Mild-Hybrid M Performance xDrive',
'transmission': 'automatic',
'trim': 'M Performance xDrive',
'year': 2025}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Saving data for NB27251: {'auction_closing_time': 1774883799.0, 'created_time': 1773917434.791458, 'last_price_update_time': 1774809715.886799}
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB27251') HTTP/1.1" 204 0
2026-03-29 18:41:55 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-29 18:41:55 [auto1.de] INFO: Scrape type for HR27692: 2
2026-03-29 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-29 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe34305e-32dd-5705-aee0-73c52ad7fd9d with scrape type 2
2026-03-29 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe34305e-32dd-5705-aee0-73c52ad7fd9d with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe34305e-32dd-5705-aee0-73c52ad7fd9d, identifier: HR27692
2026-03-29 18:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-29 18:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-29 18:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692 to the API
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:38:51Z',
'fuel_type': 'petrol',
'id': 'fe34305e-32dd-5705-aee0-73c52ad7fd9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR27692',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 155016,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-12',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Saving data for HR27692: {'auction_closing_time': 1774885131.0, 'created_time': 1773383253.046544, 'last_price_update_time': 1774809716.358025}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR27692') HTTP/1.1" 204 0
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Scrape type for PN60983: 2
2026-03-29 18:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983
2026-03-29 18:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d074fd29-ff5d-58e4-9289-94b1e0fd9295 with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d074fd29-ff5d-58e4-9289-94b1e0fd9295 with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d074fd29-ff5d-58e4-9289-94b1e0fd9295, identifier: PN60983
2026-03-29 18:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983
2026-03-29 18:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983
2026-03-29 18:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983 to the API
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:53:06Z',
'fuel_type': 'diesel',
'id': 'd074fd29-ff5d-58e4-9289-94b1e0fd9295',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN60983',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 220890,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-06',
'seller_name': None,
'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Trend Edition',
'transmission': 'automatic',
'trim': 'kompakt BlueEfficiency Trend Edition',
'year': 2012}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Saving data for PN60983: {'auction_closing_time': 1774885986.0, 'created_time': 1774510533.833887, 'last_price_update_time': 1774809716.842842}
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN60983') HTTP/1.1" 204 0
2026-03-29 18:41:56 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-29 18:41:56 [auto1.de] INFO: Scrape type for WC52225: 2
2026-03-29 18:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-29 18:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with scrape type 2
2026-03-29 18:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f, identifier: WC52225
2026-03-29 18:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-29 18:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-29 18:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225 to the API
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:40:06Z',
'fuel_type': 'petrol',
'id': '2b433e72-a5e0-54ef-8eb0-cb54c1041f3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC52225',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 115829,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-17',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
'transmission': 'automatic',
'trim': '4Matic Exclusive',
'year': 2018}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Saving data for WC52225: {'auction_closing_time': 1774885206.0, 'created_time': 1773861700.769657, 'last_price_update_time': 1774809717.31192}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC52225') HTTP/1.1" 204 0
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Scrape type for EW68189: 2
2026-03-29 18:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-29 18:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f3f1ae1-20c1-58f8-af34-8247319d0ada with scrape type 2
2026-03-29 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f3f1ae1-20c1-58f8-af34-8247319d0ada with scrape type 2
2026-03-29 18:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f3f1ae1-20c1-58f8-af34-8247319d0ada, identifier: EW68189
2026-03-29 18:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-29 18:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-29 18:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189 to the API
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:30:33Z',
'fuel_type': 'petrol',
'id': '7f3f1ae1-20c1-58f8-af34-8247319d0ada',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW68189',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 120296,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-20',
'seller_name': None,
'title': 'MINI Countryman Cooper S ALL4',
'transmission': 'manual',
'trim': 'ALL4',
'year': 2011}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Saving data for EW68189: {'auction_closing_time': 1774884633.0, 'created_time': 1773427083.243122, 'last_price_update_time': 1774809717.869348}
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW68189') HTTP/1.1" 204 0
2026-03-29 18:41:57 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-29 18:41:57 [auto1.de] INFO: Scrape type for TT67708: 2
2026-03-29 18:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-29 18:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with scrape type 2
2026-03-29 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29, identifier: TT67708
2026-03-29 18:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-29 18:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-29 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708 to the API
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:18:44Z',
'fuel_type': 'petrol',
'id': 'd5e2a440-ab5f-5aac-b6b5-b1a3aa158d29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT67708',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 146568,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-03',
'seller_name': None,
'title': 'Hyundai i30 1.4 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Saving data for TT67708: {'auction_closing_time': 1774883924.0, 'created_time': 1773380656.297527, 'last_price_update_time': 1774809718.375437}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT67708') HTTP/1.1" 204 0
2026-03-29 18:41:58 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-29 18:41:58 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-29 18:41:58 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Scrape type for TL68554: 2
2026-03-29 18:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-29 18:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5, identifier: TL68554
2026-03-29 18:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-29 18:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554
2026-03-29 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8315b0f-e112-57a0-bca8-ddb5fbd2bed5 with identifier: TL68554 to the API
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:03Z',
'fuel_type': 'petrol',
'id': 'a8315b0f-e112-57a0-bca8-ddb5fbd2bed5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL68554',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 50884,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2020}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Saving data for TL68554: {'auction_closing_time': 1774885443.0, 'created_time': 1774521601.311613, 'last_price_update_time': 1774809718.775469}
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL68554') HTTP/1.1" 204 0
2026-03-29 18:41:58 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-29 18:41:58 [auto1.de] INFO: Scrape type for VU36521: 2
2026-03-29 18:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521
2026-03-29 18:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c59384e-d3cf-5960-90cb-ef16f1765d0a with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c59384e-d3cf-5960-90cb-ef16f1765d0a with scrape type 2
2026-03-29 18:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c59384e-d3cf-5960-90cb-ef16f1765d0a, identifier: VU36521
2026-03-29 18:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521
2026-03-29 18:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521
2026-03-29 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c59384e-d3cf-5960-90cb-ef16f1765d0a with identifier: VU36521 to the API
2026-03-29 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:38:53Z',
'fuel_type': 'petrol',
'id': '5c59384e-d3cf-5960-90cb-ef16f1765d0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU36521',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 46968,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-11',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2021}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Saving data for VU36521: {'auction_closing_time': 1774885133.0, 'created_time': 1774723156.5892, 'last_price_update_time': 1774809719.173996}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU36521') HTTP/1.1" 204 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for EZ09435: 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for GW17934: 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for UE69699: 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for LK78678: 2
2026-03-29 18:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678
2026-03-29 18:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c4f06d-9cef-53e2-b673-c7aecafc8973 with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76c4f06d-9cef-53e2-b673-c7aecafc8973 with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76c4f06d-9cef-53e2-b673-c7aecafc8973, identifier: LK78678
2026-03-29 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678
2026-03-29 18:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678
2026-03-29 18:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76c4f06d-9cef-53e2-b673-c7aecafc8973 with identifier: LK78678 to the API
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:43:19Z',
'fuel_type': 'diesel',
'id': '76c4f06d-9cef-53e2-b673-c7aecafc8973',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK78678',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 125505,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-08',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2015}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Saving data for LK78678: {'auction_closing_time': 1774885399.0, 'created_time': 1774636665.493812, 'last_price_update_time': 1774809719.67497}
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK78678') HTTP/1.1" 204 0
2026-03-29 18:41:59 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-29 18:41:59 [auto1.de] INFO: Scrape type for HY74574: 2
2026-03-29 18:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-29 18:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85474071-9d19-5f7a-a02f-3cf7a61694a9 with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85474071-9d19-5f7a-a02f-3cf7a61694a9 with scrape type 2
2026-03-29 18:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85474071-9d19-5f7a-a02f-3cf7a61694a9, identifier: HY74574
2026-03-29 18:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-29 18:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-29 18:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574 to the API
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:26:05Z',
'fuel_type': 'petrol',
'id': '85474071-9d19-5f7a-a02f-3cf7a61694a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY74574',
'listing': 'auction',
'make': 'Ford',
'model': 'EcoSport',
'odometer': 47136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-12',
'seller_name': None,
'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Saving data for HY74574: {'auction_closing_time': 1774884365.0, 'created_time': 1773860952.842866, 'last_price_update_time': 1774809720.269604}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY74574') HTTP/1.1" 204 0
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Scrape type for HD50866: 0
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Scrape type for KP72429: 2
2026-03-29 18:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-29 18:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6, identifier: KP72429
2026-03-29 18:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-29 18:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-29 18:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429 to the API
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:19:56Z',
'fuel_type': 'petrol',
'id': '34befb9a-7dd6-5454-b9b1-c05fb88e5ab6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP72429',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 92911,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-16',
'seller_name': None,
'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
'transmission': 'automatic',
'trim': 'GT Line 4WD',
'year': 2019}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Saving data for KP72429: {'auction_closing_time': 1774883996.0, 'created_time': 1773383440.157252, 'last_price_update_time': 1774809720.701371}
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP72429') HTTP/1.1" 204 0
2026-03-29 18:42:00 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Scrape type for SN40806: 0
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-29 18:42:00 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-29 18:42:00 [auto1.de] INFO: Scrape type for WZ14073: 2
2026-03-29 18:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-29 18:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b3067c3-6224-5209-a487-6c2423e66851 with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b3067c3-6224-5209-a487-6c2423e66851 with scrape type 2
2026-03-29 18:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b3067c3-6224-5209-a487-6c2423e66851, identifier: WZ14073
2026-03-29 18:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-29 18:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-29 18:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073 to the API
2026-03-29 18:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:20:58Z',
'fuel_type': 'petrol',
'id': '6b3067c3-6224-5209-a487-6c2423e66851',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ14073',
'listing': 'auction',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 109419,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-20',
'seller_name': None,
'title': 'MINI Cabrio Cooper',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Saving data for WZ14073: {'auction_closing_time': 1774884058.0, 'created_time': 1774607833.785624, 'last_price_update_time': 1774809721.172808}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ14073') HTTP/1.1" 204 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for BC48090: 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for YV87591: 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for VU37583: 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for VS89065: 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for KK06519: 2
2026-03-29 18:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-29 18:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0146879-0287-542e-b052-34b9c77493ae with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0146879-0287-542e-b052-34b9c77493ae with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0146879-0287-542e-b052-34b9c77493ae, identifier: KK06519
2026-03-29 18:42:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-29 18:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-29 18:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-29 18:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519 to the API
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:55:46Z',
'fuel_type': 'diesel',
'id': 'c0146879-0287-542e-b052-34b9c77493ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK06519',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XE',
'odometer': 112733,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-30',
'seller_name': None,
'title': 'Jaguar XE 20d Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2015}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Saving data for KK06519: {'auction_closing_time': 1774886146.0, 'created_time': 1774034603.13968, 'last_price_update_time': 1774809721.71986}
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK06519') HTTP/1.1" 204 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for NT80809: 0
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-29 18:42:01 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-29 18:42:01 [auto1.de] INFO: Scrape type for HV64790: 2
2026-03-29 18:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-29 18:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with scrape type 2
2026-03-29 18:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8, identifier: HV64790
2026-03-29 18:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-29 18:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-29 18:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790 to the API
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:01:31Z',
'fuel_type': 'diesel',
'id': 'a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV64790',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 185594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-01',
'seller_name': None,
'title': 'BMW 2er 218d Active Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Saving data for HV64790: {'auction_closing_time': 1774882891.0, 'created_time': 1774608348.986745, 'last_price_update_time': 1774809722.291148}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV64790') HTTP/1.1" 204 0
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Scrape type for NF12247: 0
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Scrape type for MK79183: 0
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Scrape type for LR85001: 2
2026-03-29 18:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-29 18:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8855642-69c3-5419-94e0-4fedac5943c0 with scrape type 2
2026-03-29 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8855642-69c3-5419-94e0-4fedac5943c0 with scrape type 2
2026-03-29 18:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8855642-69c3-5419-94e0-4fedac5943c0, identifier: LR85001
2026-03-29 18:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-29 18:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-29 18:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001 to the API
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:33:43Z',
'fuel_type': 'diesel',
'id': 'd8855642-69c3-5419-94e0-4fedac5943c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR85001',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 296009,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-09',
'seller_name': None,
'title': 'Mercedes-Benz Vito 114 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2017}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Saving data for LR85001: {'auction_closing_time': 1774884823.0, 'created_time': 1773401169.283806, 'last_price_update_time': 1774809722.815211}
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR85001') HTTP/1.1" 204 0
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-29 18:42:02 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-29 18:42:02 [auto1.de] INFO: Scrape type for TW44182: 2
2026-03-29 18:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-29 18:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with scrape type 2
2026-03-29 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with scrape type 2
2026-03-29 18:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e2cb989-aea7-5d9f-80a9-95f8506662a2, identifier: TW44182
2026-03-29 18:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-29 18:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-29 18:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182 to the API
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:06:55Z',
'fuel_type': 'hybrid',
'id': '2e2cb989-aea7-5d9f-80a9-95f8506662a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW44182',
'listing': 'auction',
'make': 'Lexus',
'model': 'RX-Serie',
'odometer': 129826,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-15',
'seller_name': None,
'title': 'Lexus RX-Serie RX 450h Impression',
'transmission': 'automatic',
'trim': 'Impression',
'year': 2010}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Saving data for TW44182: {'auction_closing_time': 1774883215.0, 'created_time': 1774608527.39522, 'last_price_update_time': 1774809723.363984}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW44182') HTTP/1.1" 204 0
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Scrape type for BW06665: 0
2026-03-29 18:42:03 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Scrape type for RJ71204: 2
2026-03-29 18:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-29 18:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95a1df0-e40c-50bd-9721-20cf7e298200 with scrape type 2
2026-03-29 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95a1df0-e40c-50bd-9721-20cf7e298200 with scrape type 2
2026-03-29 18:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e95a1df0-e40c-50bd-9721-20cf7e298200, identifier: RJ71204
2026-03-29 18:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-29 18:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-29 18:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204 to the API
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:16:32Z',
'fuel_type': 'diesel',
'id': 'e95a1df0-e40c-50bd-9721-20cf7e298200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ71204',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 130501,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-20',
'seller_name': None,
'title': 'Volvo V90 2.0 D4 R-Design',
'transmission': 'automatic',
'trim': 'R-Design',
'year': 2019}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-29 18:42:03 [auto1.de] INFO: Saving data for RJ71204: {'auction_closing_time': 1774883792.0, 'created_time': 1774291517.558018, 'last_price_update_time': 1774809723.982322}
2026-03-29 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ71204') HTTP/1.1" 204 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for RK85869: 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for ZH34670: 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for BE15343: 2
2026-03-29 18:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-29 18:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c47b4df3-a17d-5f37-868c-ff87d9fdd66d, identifier: BE15343
2026-03-29 18:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-29 18:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-29 18:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343 to the API
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:46:57Z',
'fuel_type': 'diesel',
'id': 'c47b4df3-a17d-5f37-868c-ff87d9fdd66d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE15343',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 37227,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Saving data for BE15343: {'auction_closing_time': 1774885617.0, 'created_time': 1774607830.081576, 'last_price_update_time': 1774809724.514815}
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE15343') HTTP/1.1" 204 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for WD35847: 0
2026-03-29 18:42:04 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Scrape type for EN88282: 2
2026-03-29 18:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282
2026-03-29 18:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3f53be-dd34-55d0-89a4-9472a2a37450 with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c3f53be-dd34-55d0-89a4-9472a2a37450 with scrape type 2
2026-03-29 18:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c3f53be-dd34-55d0-89a4-9472a2a37450, identifier: EN88282
2026-03-29 18:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282
2026-03-29 18:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282
2026-03-29 18:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c3f53be-dd34-55d0-89a4-9472a2a37450 with identifier: EN88282 to the API
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:58:05Z',
'fuel_type': 'petrol',
'id': '2c3f53be-dd34-55d0-89a4-9472a2a37450',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN88282',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 205834,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-13',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2015}
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-29 18:42:04 [auto1.de] INFO: Saving data for EN88282: {'auction_closing_time': 1774886285.0, 'created_time': 1773946077.385918, 'last_price_update_time': 1774809724.933961}
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN88282') HTTP/1.1" 204 0
2026-03-29 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for ZY80421: 2
2026-03-29 18:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-29 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612908d7-ef20-59ba-8b4e-6619ad523824 with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612908d7-ef20-59ba-8b4e-6619ad523824 with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612908d7-ef20-59ba-8b4e-6619ad523824, identifier: ZY80421
2026-03-29 18:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-29 18:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421
2026-03-29 18:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612908d7-ef20-59ba-8b4e-6619ad523824 with identifier: ZY80421 to the API
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:32:49Z',
'fuel_type': 'petrol',
'id': '612908d7-ef20-59ba-8b4e-6619ad523824',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY80421',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 220116,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-08',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Team Edition',
'transmission': 'manual',
'trim': 'Team Edition',
'year': 2008}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Saving data for ZY80421: {'auction_closing_time': 1774884769.0, 'created_time': 1774521890.753075, 'last_price_update_time': 1774809725.431349}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY80421') HTTP/1.1" 204 0
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for PU85783: 2
2026-03-29 18:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783
2026-03-29 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe931aa-3057-5dba-8493-dbe3262a6426 with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe931aa-3057-5dba-8493-dbe3262a6426 with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe931aa-3057-5dba-8493-dbe3262a6426, identifier: PU85783
2026-03-29 18:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783
2026-03-29 18:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783
2026-03-29 18:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe931aa-3057-5dba-8493-dbe3262a6426 with identifier: PU85783 to the API
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:51:23Z',
'fuel_type': 'petrol',
'id': 'cfe931aa-3057-5dba-8493-dbe3262a6426',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU85783',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 119098,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-10',
'seller_name': None,
'title': 'Ford B-Max 1.6 Ti-VCT SYNC Edition',
'transmission': 'automatic',
'trim': 'SYNC Edition',
'year': 2016}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Saving data for PU85783: {'auction_closing_time': 1774885883.0, 'created_time': 1774550125.718926, 'last_price_update_time': 1774809725.865632}
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU85783') HTTP/1.1" 204 0
2026-03-29 18:42:05 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:05 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-29 18:42:05 [auto1.de] INFO: Scrape type for MS83797: 2
2026-03-29 18:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-29 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with scrape type 2
2026-03-29 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba, identifier: MS83797
2026-03-29 18:42:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-29 18:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797
2026-03-29 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5096e04a-1eb3-5c5f-be0a-a09195bf10ba with identifier: MS83797 to the API
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:12:49Z',
'fuel_type': 'petrol',
'id': '5096e04a-1eb3-5c5f-be0a-a09195bf10ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS83797',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 193019,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-17',
'seller_name': None,
'title': 'Dacia Lodgy 1.2 TCe Stepway Celebration',
'transmission': 'manual',
'trim': 'Stepway Celebration',
'year': 2017}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Saving data for MS83797: {'auction_closing_time': 1774883569.0, 'created_time': 1774521824.53306, 'last_price_update_time': 1774809726.264719}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS83797') HTTP/1.1" 204 0
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Scrape type for XK33490: 2
2026-03-29 18:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-29 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1, identifier: XK33490
2026-03-29 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-29 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490
2026-03-29 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 653584ff-c1e3-5e4e-985b-b7fb4c81b7f1 with identifier: XK33490 to the API
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:51:59Z',
'fuel_type': 'petrol',
'id': '653584ff-c1e3-5e4e-985b-b7fb4c81b7f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK33490',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 56717,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-19',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2019}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Saving data for XK33490: {'auction_closing_time': 1774885919.0, 'created_time': 1774521697.438965, 'last_price_update_time': 1774809726.700421}
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK33490') HTTP/1.1" 204 0
2026-03-29 18:42:06 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-29 18:42:06 [auto1.de] INFO: Scrape type for JD54519: 2
2026-03-29 18:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-29 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82613229-5d6b-5cac-baf3-14872d15bd46 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82613229-5d6b-5cac-baf3-14872d15bd46 with scrape type 2
2026-03-29 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82613229-5d6b-5cac-baf3-14872d15bd46, identifier: JD54519
2026-03-29 18:42:06 [scrapy.extensions.logstats] INFO: Crawled 84 pages (at 9 pages/min), scraped 663 items (at 107 items/min)
2026-03-29 18:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-29 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519
2026-03-29 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82613229-5d6b-5cac-baf3-14872d15bd46 with identifier: JD54519 to the API
2026-03-29 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:32:59Z',
'fuel_type': 'diesel',
'id': '82613229-5d6b-5cac-baf3-14872d15bd46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD54519',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 167835,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-29 18:42:07 [auto1.de] INFO: Saving data for JD54519: {'auction_closing_time': 1774884779.0, 'created_time': 1774521924.19585, 'last_price_update_time': 1774809727.167415}
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD54519') HTTP/1.1" 204 0
2026-03-29 18:42:07 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-29 18:42:07 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-29 18:42:07 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS42383%27 HTTP/1.1" 200 None
2026-03-29 18:42:07 [auto1.de] INFO: Scrape type for KS42383: 2
2026-03-29 18:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383
2026-03-29 18:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a55837f-c156-5368-bf89-02a38d708fc2 with scrape type 2
2026-03-29 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a55837f-c156-5368-bf89-02a38d708fc2 with scrape type 2
2026-03-29 18:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a55837f-c156-5368-bf89-02a38d708fc2, identifier: KS42383
2026-03-29 18:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383
2026-03-29 18:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383
2026-03-29 18:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a55837f-c156-5368-bf89-02a38d708fc2 with identifier: KS42383 to the API
2026-03-29 18:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:17:10Z',
'fuel_type': 'diesel',
'id': '1a55837f-c156-5368-bf89-02a38d708fc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS42383',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Captiva',
'odometer': 213339,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-31',
'seller_name': None,
'title': 'Chevrolet Captiva 2.2 Diesel D LT+',
'transmission': 'manual',
'trim': 'D LT+',
'year': 2012}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS42383%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Saving data for KS42383: {'auction_closing_time': 1774883830.0, 'created_time': 1774118675.105694, 'last_price_update_time': 1774809728.38533}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS42383') HTTP/1.1" 204 0
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Scrape type for YB86536: 0
2026-03-29 18:42:08 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Scrape type for FG75722: 2
2026-03-29 18:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-29 18:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde0ec8c-45aa-5e02-b369-316e5f37737a with scrape type 2
2026-03-29 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde0ec8c-45aa-5e02-b369-316e5f37737a with scrape type 2
2026-03-29 18:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde0ec8c-45aa-5e02-b369-316e5f37737a, identifier: FG75722
2026-03-29 18:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-29 18:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-29 18:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722 to the API
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:28:52Z',
'fuel_type': 'petrol',
'id': 'cde0ec8c-45aa-5e02-b369-316e5f37737a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG75722',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 105146,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-13',
'seller_name': None,
'title': 'Audi Q2 40 TFSI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-29 18:42:08 [auto1.de] INFO: Saving data for FG75722: {'auction_closing_time': 1774884532.0, 'created_time': 1773689318.878938, 'last_price_update_time': 1774809728.959934}
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG75722') HTTP/1.1" 204 0
2026-03-29 18:42:09 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-29 18:42:09 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-29 18:42:09 [auto1.de] INFO: Scrape type for LG84508: 2
2026-03-29 18:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508
2026-03-29 18:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef61d23f-f3fa-509e-b154-25e4e1e4805d with scrape type 2
2026-03-29 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef61d23f-f3fa-509e-b154-25e4e1e4805d with scrape type 2
2026-03-29 18:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef61d23f-f3fa-509e-b154-25e4e1e4805d, identifier: LG84508
2026-03-29 18:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508
2026-03-29 18:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508
2026-03-29 18:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef61d23f-f3fa-509e-b154-25e4e1e4805d with identifier: LG84508 to the API
2026-03-29 18:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:12Z',
'fuel_type': 'diesel',
'id': 'ef61d23f-f3fa-509e-b154-25e4e1e4805d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG84508',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 49924,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-11',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Maxi Highline BlueMotion',
'year': 2017}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Saving data for LG84508: {'auction_closing_time': 1774883352.0, 'created_time': 1774636637.757656, 'last_price_update_time': 1774809730.373775}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG84508') HTTP/1.1" 204 0
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Scrape type for YZ54178: 2
2026-03-29 18:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-29 18:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d904c0d-27fa-5839-a373-84088e8e493a with scrape type 2
2026-03-29 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d904c0d-27fa-5839-a373-84088e8e493a with scrape type 2
2026-03-29 18:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d904c0d-27fa-5839-a373-84088e8e493a, identifier: YZ54178
2026-03-29 18:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-29 18:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-29 18:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178 to the API
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:43:01Z',
'fuel_type': 'petrol',
'id': '4d904c0d-27fa-5839-a373-84088e8e493a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ54178',
'listing': 'auction',
'make': 'Audi',
'model': 'S3',
'odometer': 179068,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-25',
'seller_name': None,
'title': 'Audi S3 2.0 TFSI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2007}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Saving data for YZ54178: {'auction_closing_time': 1774885381.0, 'created_time': 1774291073.364745, 'last_price_update_time': 1774809730.817621}
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ54178') HTTP/1.1" 204 0
2026-03-29 18:42:10 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-29 18:42:10 [auto1.de] INFO: Scrape type for UW12612: 2
2026-03-29 18:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-29 18:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de1cf38f-3434-515f-a864-ed303f5dc0c3 with scrape type 2
2026-03-29 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de1cf38f-3434-515f-a864-ed303f5dc0c3 with scrape type 2
2026-03-29 18:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de1cf38f-3434-515f-a864-ed303f5dc0c3, identifier: UW12612
2026-03-29 18:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-29 18:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612
2026-03-29 18:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de1cf38f-3434-515f-a864-ed303f5dc0c3 with identifier: UW12612 to the API
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 76,
'expiration_date': '2026-03-30T15:25:31Z',
'fuel_type': 'diesel',
'id': 'de1cf38f-3434-515f-a864-ed303f5dc0c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW12612',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 30394,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-29',
'seller_name': None,
'title': 'Opel Combo 1.5 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2018}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Saving data for UW12612: {'auction_closing_time': 1774884331.0, 'created_time': 1774522491.527599, 'last_price_update_time': 1774809731.252663}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW12612') HTTP/1.1" 204 0
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Scrape type for NR35132: 0
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Scrape type for KE42269: 2
2026-03-29 18:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-29 18:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09fc1083-9f78-53bc-a60f-12850c60d0cc with scrape type 2
2026-03-29 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09fc1083-9f78-53bc-a60f-12850c60d0cc with scrape type 2
2026-03-29 18:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09fc1083-9f78-53bc-a60f-12850c60d0cc, identifier: KE42269
2026-03-29 18:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-29 18:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-29 18:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269 to the API
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:06:19Z',
'fuel_type': 'diesel',
'id': '09fc1083-9f78-53bc-a60f-12850c60d0cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE42269',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 111953,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-07',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2017}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Saving data for KE42269: {'auction_closing_time': 1774883179.0, 'created_time': 1774291383.186723, 'last_price_update_time': 1774809731.777803}
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE42269') HTTP/1.1" 204 0
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Scrape type for AC77037: 0
2026-03-29 18:42:11 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-29 18:42:11 [auto1.de] INFO: Scrape type for LT68556: 2
2026-03-29 18:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-29 18:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with scrape type 2
2026-03-29 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a50451e-ab53-50ed-8c20-f2a44ca81a22, identifier: LT68556
2026-03-29 18:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-29 18:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-29 18:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556 to the API
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:59:11Z',
'fuel_type': 'diesel',
'id': '9a50451e-ab53-50ed-8c20-f2a44ca81a22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT68556',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 242542,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-22',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Saving data for LT68556: {'auction_closing_time': 1774886351.0, 'created_time': 1774608517.035784, 'last_price_update_time': 1774809732.38751}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT68556') HTTP/1.1" 204 0
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Scrape type for NS17757: 2
2026-03-29 18:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-29 18:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0, identifier: NS17757
2026-03-29 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-29 18:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757
2026-03-29 18:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12239576-3b7e-5993-be8c-0a0bfcb2f8f0 with identifier: NS17757 to the API
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:11:26Z',
'fuel_type': 'diesel',
'id': '12239576-3b7e-5993-be8c-0a0bfcb2f8f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS17757',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 67014,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-09',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'automatic',
'trim': '350 L3 Trend',
'year': 2021}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Saving data for NS17757: {'auction_closing_time': 1774883486.0, 'created_time': 1774522631.747538, 'last_price_update_time': 1774809732.779965}
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS17757') HTTP/1.1" 204 0
2026-03-29 18:42:12 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-29 18:42:12 [auto1.de] INFO: Scrape type for PA20304: 2
2026-03-29 18:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-29 18:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17c774f4-b417-59c9-80e4-a49e0620b47c with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17c774f4-b417-59c9-80e4-a49e0620b47c with scrape type 2
2026-03-29 18:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17c774f4-b417-59c9-80e4-a49e0620b47c, identifier: PA20304
2026-03-29 18:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-29 18:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-29 18:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304 to the API
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:17:23Z',
'fuel_type': 'diesel',
'id': '17c774f4-b417-59c9-80e4-a49e0620b47c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA20304',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix35',
'odometer': 91106,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': None,
'title': 'Hyundai ix35 1.7 CRDi FIFA World Cup Edition 2WD',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition 2WD',
'year': 2014}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Saving data for PA20304: {'auction_closing_time': 1774883843.0, 'created_time': 1774350283.299845, 'last_price_update_time': 1774809733.286413}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA20304') HTTP/1.1" 204 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for RF69391: 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for LL99453: 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for YT13980: 0
2026-03-29 18:42:13 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for GV20028: 2
2026-03-29 18:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-29 18:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3136b3ae-e420-5266-906c-a11d1d526dfd with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3136b3ae-e420-5266-906c-a11d1d526dfd with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3136b3ae-e420-5266-906c-a11d1d526dfd, identifier: GV20028
2026-03-29 18:42:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-29 18:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-29 18:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028 to the API
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:31:00Z',
'fuel_type': 'diesel',
'id': '3136b3ae-e420-5266-906c-a11d1d526dfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV20028',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 234382,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-16',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2017}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Saving data for GV20028: {'auction_closing_time': 1774884660.0, 'created_time': 1774349872.15789, 'last_price_update_time': 1774809733.785528}
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV20028') HTTP/1.1" 204 0
2026-03-29 18:42:13 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-29 18:42:13 [auto1.de] INFO: Scrape type for SM28331: 2
2026-03-29 18:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-29 18:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c995a-e7d7-51fa-81a9-153413786cc6 with scrape type 2
2026-03-29 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606c995a-e7d7-51fa-81a9-153413786cc6 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 606c995a-e7d7-51fa-81a9-153413786cc6, identifier: SM28331
2026-03-29 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-29 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-29 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331 to the API
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:19:22Z',
'fuel_type': 'diesel',
'id': '606c995a-e7d7-51fa-81a9-153413786cc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM28331',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 134592,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-14',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Saving data for SM28331: {'auction_closing_time': 1774883962.0, 'created_time': 1774607843.283709, 'last_price_update_time': 1774809734.344251}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM28331') HTTP/1.1" 204 0
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Scrape type for XJ33844: 2
2026-03-29 18:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-29 18:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1912f5-56a8-59f8-8454-39d5c4842405 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1912f5-56a8-59f8-8454-39d5c4842405 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc1912f5-56a8-59f8-8454-39d5c4842405, identifier: XJ33844
2026-03-29 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-29 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844
2026-03-29 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc1912f5-56a8-59f8-8454-39d5c4842405 with identifier: XJ33844 to the API
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:44:08Z',
'fuel_type': 'diesel',
'id': 'dc1912f5-56a8-59f8-8454-39d5c4842405',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ33844',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 167229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-08',
'seller_name': None,
'title': 'Peugeot 208 1.6 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2015}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Saving data for XJ33844: {'auction_closing_time': 1774885448.0, 'created_time': 1774522164.144774, 'last_price_update_time': 1774809734.743345}
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ33844') HTTP/1.1" 204 0
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Scrape type for XY66672: 0
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-29 18:42:14 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-29 18:42:14 [auto1.de] INFO: Scrape type for TP66547: 2
2026-03-29 18:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-29 18:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce11b67-18e3-52af-b042-c85f648a1906 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fce11b67-18e3-52af-b042-c85f648a1906 with scrape type 2
2026-03-29 18:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fce11b67-18e3-52af-b042-c85f648a1906, identifier: TP66547
2026-03-29 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-29 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-29 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547 to the API
2026-03-29 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:58:13Z',
'fuel_type': 'diesel',
'id': 'fce11b67-18e3-52af-b042-c85f648a1906',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP66547',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Grandis',
'odometer': 204619,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-04',
'seller_name': None,
'title': 'Mitsubishi Grandis 2.0 DI-D Intense',
'transmission': 'manual',
'trim': 'Intense',
'year': 2008}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Saving data for TP66547: {'auction_closing_time': 1774886293.0, 'created_time': 1773380910.472055, 'last_price_update_time': 1774809735.208881}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP66547') HTTP/1.1" 204 0
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Scrape type for VP25295: 2
2026-03-29 18:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295
2026-03-29 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a925cbb1-bf69-5d61-a8f0-ec76ac647156 with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a925cbb1-bf69-5d61-a8f0-ec76ac647156 with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a925cbb1-bf69-5d61-a8f0-ec76ac647156, identifier: VP25295
2026-03-29 18:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295
2026-03-29 18:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295
2026-03-29 18:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a925cbb1-bf69-5d61-a8f0-ec76ac647156 with identifier: VP25295 to the API
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:07:14Z',
'fuel_type': 'diesel',
'id': 'a925cbb1-bf69-5d61-a8f0-ec76ac647156',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP25295',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 104089,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-04',
'seller_name': None,
'title': 'Opel Vivaro 2.0 Diesel M Edition L2',
'transmission': 'manual',
'trim': 'M Edition L2',
'year': 2020}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Saving data for VP25295: {'auction_closing_time': 1774883234.0, 'created_time': 1774034785.766573, 'last_price_update_time': 1774809735.702032}
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP25295') HTTP/1.1" 204 0
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Scrape type for BK52975: 0
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-29 18:42:15 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-29 18:42:15 [auto1.de] INFO: Scrape type for DE77804: 2
2026-03-29 18:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-29 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3b8874-fe0d-5b78-b639-10d5a47a172c with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e3b8874-fe0d-5b78-b639-10d5a47a172c with scrape type 2
2026-03-29 18:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e3b8874-fe0d-5b78-b639-10d5a47a172c, identifier: DE77804
2026-03-29 18:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-29 18:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-29 18:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804 to the API
2026-03-29 18:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:55Z',
'fuel_type': 'diesel',
'id': '6e3b8874-fe0d-5b78-b639-10d5a47a172c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE77804',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 177625,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-13',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2016}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Saving data for DE77804: {'auction_closing_time': 1774883935.0, 'created_time': 1774294179.848863, 'last_price_update_time': 1774809736.18406}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE77804') HTTP/1.1" 204 0
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for RG76834: 2
2026-03-29 18:42:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-29 18:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9fe0ef-8338-5fda-b3fd-dac274aa566a with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9fe0ef-8338-5fda-b3fd-dac274aa566a with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9fe0ef-8338-5fda-b3fd-dac274aa566a, identifier: RG76834
2026-03-29 18:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-29 18:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-29 18:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834 to the API
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:57:02Z',
'fuel_type': 'petrol',
'id': 'ba9fe0ef-8338-5fda-b3fd-dac274aa566a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG76834',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 133356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-14',
'seller_name': None,
'title': 'Honda Jazz 1.2 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Saving data for RG76834: {'auction_closing_time': 1774886222.0, 'created_time': 1774608053.998473, 'last_price_update_time': 1774809736.629293}
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG76834') HTTP/1.1" 204 0
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for MN63665: 0
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for WH84573: 0
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for JL94841: 0
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for KC01296: 0
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-29 18:42:16 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-29 18:42:16 [auto1.de] INFO: Scrape type for MV77064: 2
2026-03-29 18:42:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-29 18:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with scrape type 2
2026-03-29 18:42:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713, identifier: MV77064
2026-03-29 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-29 18:42:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064
2026-03-29 18:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713 with identifier: MV77064 to the API
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:17:22Z',
'fuel_type': 'petrol',
'id': '7ae2c2c8-a365-59c9-b6e3-d1d3eb4dd713',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV77064',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 96524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-02',
'seller_name': None,
'title': 'BMW X1 xDrive 20i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Saving data for MV77064: {'auction_closing_time': 1774883842.0, 'created_time': 1774522109.583671, 'last_price_update_time': 1774809737.214982}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV77064') HTTP/1.1" 204 0
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Scrape type for UC78580: 0
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Scrape type for HZ18082: 0
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Scrape type for MX99530: 0
2026-03-29 18:42:17 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Scrape type for KV22200: 2
2026-03-29 18:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-29 18:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with scrape type 2
2026-03-29 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with scrape type 2
2026-03-29 18:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d, identifier: KV22200
2026-03-29 18:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-29 18:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-29 18:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200 to the API
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:44:46Z',
'fuel_type': 'petrol',
'id': 'dc39fa41-ec43-5868-8f4f-2ec14a28bc7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV22200',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 101003,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-27',
'seller_name': None,
'title': 'Renault Twingo 1.2 Rip Curl',
'transmission': 'manual',
'trim': 'Rip Curl',
'year': 2011}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Saving data for KV22200: {'auction_closing_time': 1774885486.0, 'created_time': 1774608513.908405, 'last_price_update_time': 1774809737.786403}
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV22200') HTTP/1.1" 204 0
2026-03-29 18:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:17 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-29 18:42:17 [auto1.de] INFO: Scrape type for MV46979: 2
2026-03-29 18:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-29 18:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9d0c6b-fb03-5824-9546-47daf1064832 with scrape type 2
2026-03-29 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f9d0c6b-fb03-5824-9546-47daf1064832 with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f9d0c6b-fb03-5824-9546-47daf1064832, identifier: MV46979
2026-03-29 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-29 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-29 18:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979 to the API
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:51:47Z',
'fuel_type': 'petrol',
'id': '8f9d0c6b-fb03-5824-9546-47daf1064832',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV46979',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 119885,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-28',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Saving data for MV46979: {'auction_closing_time': 1774885907.0, 'created_time': 1774608575.467988, 'last_price_update_time': 1774809738.320281}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV46979') HTTP/1.1" 204 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for YB52644: 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for SH34786: 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for UG24808: 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for WA42384: 2
2026-03-29 18:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-29 18:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9526d42-f1fe-5cdb-a85b-96087e793b12 with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9526d42-f1fe-5cdb-a85b-96087e793b12 with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9526d42-f1fe-5cdb-a85b-96087e793b12, identifier: WA42384
2026-03-29 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-29 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384
2026-03-29 18:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9526d42-f1fe-5cdb-a85b-96087e793b12 with identifier: WA42384 to the API
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:28:54Z',
'fuel_type': 'diesel',
'id': 'b9526d42-f1fe-5cdb-a85b-96087e793b12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42384',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 16263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-06-03',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2024}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Saving data for WA42384: {'auction_closing_time': 1774884534.0, 'created_time': 1774522197.946207, 'last_price_update_time': 1774809738.781425}
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA42384') HTTP/1.1" 204 0
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-29 18:42:18 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-29 18:42:18 [auto1.de] INFO: Scrape type for WN48846: 2
2026-03-29 18:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846
2026-03-29 18:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7612d11-eb98-5f46-ad3b-e9312df7467a with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7612d11-eb98-5f46-ad3b-e9312df7467a with scrape type 2
2026-03-29 18:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7612d11-eb98-5f46-ad3b-e9312df7467a, identifier: WN48846
2026-03-29 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846
2026-03-29 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846
2026-03-29 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7612d11-eb98-5f46-ad3b-e9312df7467a with identifier: WN48846 to the API
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:36:35Z',
'fuel_type': 'petrol',
'id': 'a7612d11-eb98-5f46-ad3b-e9312df7467a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN48846',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 166061,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-14',
'seller_name': None,
'title': 'Mazda 3 2.0 Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2014}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Saving data for WN48846: {'auction_closing_time': 1774884995.0, 'created_time': 1774636746.308072, 'last_price_update_time': 1774809739.180835}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN48846') HTTP/1.1" 204 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for BM78825: 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for WD28635: 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for GR91976: 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for NN62521: 2
2026-03-29 18:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-29 18:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec, identifier: NN62521
2026-03-29 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-29 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-29 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521 to the API
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:54:23Z',
'fuel_type': 'petrol',
'id': 'e3901b9a-4202-5c28-9f8c-178cdfe5d4ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN62521',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 165137,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-24',
'seller_name': None,
'title': 'Renault Megane 1.4 TCe BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2012}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Saving data for NN62521: {'auction_closing_time': 1774886063.0, 'created_time': 1774608108.251702, 'last_price_update_time': 1774809739.712974}
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN62521') HTTP/1.1" 204 0
2026-03-29 18:42:19 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-29 18:42:19 [auto1.de] INFO: Scrape type for FM78984: 2
2026-03-29 18:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-29 18:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e0f6b8f-8693-514f-83ad-6057e8d509fd with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e0f6b8f-8693-514f-83ad-6057e8d509fd with scrape type 2
2026-03-29 18:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e0f6b8f-8693-514f-83ad-6057e8d509fd, identifier: FM78984
2026-03-29 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-29 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984
2026-03-29 18:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e0f6b8f-8693-514f-83ad-6057e8d509fd with identifier: FM78984 to the API
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:57:05Z',
'fuel_type': 'diesel',
'id': '5e0f6b8f-8693-514f-83ad-6057e8d509fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM78984',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 180429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2018}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Saving data for FM78984: {'auction_closing_time': 1774886225.0, 'created_time': 1774521527.218854, 'last_price_update_time': 1774809740.228251}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM78984') HTTP/1.1" 204 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for TL40939: 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for BG03972: 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for DA12198: 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for HY48346: 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for YL44466: 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for KF79768: 2
2026-03-29 18:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-29 18:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdb52312-98e2-5243-ae12-319f19f84c31 with scrape type 2
2026-03-29 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdb52312-98e2-5243-ae12-319f19f84c31 with scrape type 2
2026-03-29 18:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdb52312-98e2-5243-ae12-319f19f84c31, identifier: KF79768
2026-03-29 18:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-29 18:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768
2026-03-29 18:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdb52312-98e2-5243-ae12-319f19f84c31 with identifier: KF79768 to the API
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:49:41Z',
'fuel_type': 'petrol',
'id': 'bdb52312-98e2-5243-ae12-319f19f84c31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF79768',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 196056,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-31',
'seller_name': None,
'title': 'Audi A1 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Saving data for KF79768: {'auction_closing_time': 1774885781.0, 'created_time': 1774521895.79806, 'last_price_update_time': 1774809740.73429}
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF79768') HTTP/1.1" 204 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for CX46071: 0
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-29 18:42:20 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-29 18:42:20 [auto1.de] INFO: Scrape type for PC54286: 0
2026-03-29 18:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:21 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Scrape type for JB91178: 0
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Scrape type for SZ50241: 0
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-29 18:42:21 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-29 18:42:21 [auto1.de] INFO: Scrape type for RR13548: 2
2026-03-29 18:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-29 18:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with scrape type 2
2026-03-29 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with scrape type 2
2026-03-29 18:42:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e, identifier: RR13548
2026-03-29 18:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-29 18:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-29 18:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548 to the API
2026-03-29 18:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:14Z',
'fuel_type': 'diesel',
'id': '07ac2543-6e87-54bf-9948-4bc2c2a5d49e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR13548',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 159552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-15',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2015}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Saving data for RR13548: {'auction_closing_time': 1774884434.0, 'created_time': 1773302871.025354, 'last_price_update_time': 1774809742.198485}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR13548') HTTP/1.1" 204 0
2026-03-29 18:42:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:22 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-29 18:42:22 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Scrape type for TG47191: 2
2026-03-29 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-29 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1, identifier: TG47191
2026-03-29 18:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-29 18:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191
2026-03-29 18:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1 with identifier: TG47191 to the API
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:19:51Z',
'fuel_type': 'petrol',
'id': 'fd0701b5-e81d-5962-a1ae-4d93e7a2ebf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG47191',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 208620,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-31',
'seller_name': None,
'title': 'Opel Astra 1.6 Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2008}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Saving data for TG47191: {'auction_closing_time': 1774883991.0, 'created_time': 1774034980.84504, 'last_price_update_time': 1774809742.698663}
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG47191') HTTP/1.1" 204 0
2026-03-29 18:42:22 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-29 18:42:22 [auto1.de] INFO: Scrape type for RW82332: 2
2026-03-29 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-29 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with scrape type 2
2026-03-29 18:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33, identifier: RW82332
2026-03-29 18:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-29 18:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332
2026-03-29 18:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b80cd1b-b103-5c3f-8aa8-1e961a218e33 with identifier: RW82332 to the API
2026-03-29 18:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:50:55Z',
'fuel_type': 'petrol',
'id': '6b80cd1b-b103-5c3f-8aa8-1e961a218e33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW82332',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 64132,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-12',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
'transmission': 'automatic',
'trim': 'BlueEfficiency',
'year': 2015}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Saving data for RW82332: {'auction_closing_time': 1774885855.0, 'created_time': 1774522296.620677, 'last_price_update_time': 1774809743.147262}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW82332') HTTP/1.1" 204 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for ZV10923: 2
2026-03-29 18:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-29 18:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad, identifier: ZV10923
2026-03-29 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-29 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-29 18:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923 to the API
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:16:30Z',
'fuel_type': 'petrol',
'id': '998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV10923',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 25746,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-05',
'seller_name': None,
'title': 'Fiat 500 1.2 Collezione',
'transmission': 'manual',
'trim': 'Collezione',
'year': 2018}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Saving data for ZV10923: {'auction_closing_time': 1774883790.0, 'created_time': 1774608608.022005, 'last_price_update_time': 1774809743.573486}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV10923') HTTP/1.1" 204 0
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-29 18:42:23 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-29 18:42:23 [auto1.de] INFO: Scrape type for YN11150: 2
2026-03-29 18:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-29 18:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d47f2394-b127-55c2-870b-e69723767512 with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d47f2394-b127-55c2-870b-e69723767512 with scrape type 2
2026-03-29 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d47f2394-b127-55c2-870b-e69723767512, identifier: YN11150
2026-03-29 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-29 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150
2026-03-29 18:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d47f2394-b127-55c2-870b-e69723767512 with identifier: YN11150 to the API
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:00:11Z',
'fuel_type': 'petrol',
'id': 'd47f2394-b127-55c2-870b-e69723767512',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN11150',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Space Star',
'odometer': 45610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-18',
'seller_name': None,
'title': 'Mitsubishi Space Star 1.0 Edition 100',
'transmission': 'manual',
'trim': 'Edition 100',
'year': 2018}
2026-03-29 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Saving data for YN11150: {'auction_closing_time': 1774882811.0, 'created_time': 1774521938.857293, 'last_price_update_time': 1774809744.000794}
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN11150') HTTP/1.1" 204 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for LV55380: 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for HZ95747: 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for RJ73659: 2
2026-03-29 18:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659
2026-03-29 18:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e654da7-33d3-5122-9012-128ab9ba0d97 with scrape type 2
2026-03-29 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e654da7-33d3-5122-9012-128ab9ba0d97 with scrape type 2
2026-03-29 18:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e654da7-33d3-5122-9012-128ab9ba0d97, identifier: RJ73659
2026-03-29 18:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659
2026-03-29 18:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659
2026-03-29 18:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659 to the API
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:18:47Z',
'fuel_type': 'petrol',
'id': '2e654da7-33d3-5122-9012-128ab9ba0d97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ73659',
'listing': 'auction',
'make': 'Jeep',
'model': 'Patriot',
'odometer': 218414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-24',
'seller_name': None,
'title': 'Jeep Patriot 2.4 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2010}
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Saving data for RJ73659: {'auction_closing_time': 1774883927.0, 'created_time': 1774510547.209475, 'last_price_update_time': 1774809744.498049}
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ73659') HTTP/1.1" 204 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for BS97689: 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for FZ03157: 0
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-29 18:42:24 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-29 18:42:24 [auto1.de] INFO: Scrape type for HD43211: 2
2026-03-29 18:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-29 18:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3259a4b6-7924-535d-a451-d944153ac8f9 with scrape type 2
2026-03-29 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3259a4b6-7924-535d-a451-d944153ac8f9 with scrape type 2
2026-03-29 18:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3259a4b6-7924-535d-a451-d944153ac8f9, identifier: HD43211
2026-03-29 18:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-29 18:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-29 18:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211 to the API
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:04:42Z',
'fuel_type': 'petrol',
'id': '3259a4b6-7924-535d-a451-d944153ac8f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD43211',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 170957,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-12',
'seller_name': None,
'title': 'Hyundai Kona 1.6 TGDI Style 4WD',
'transmission': 'automatic',
'trim': 'Style 4WD',
'year': 2019}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Saving data for HD43211: {'auction_closing_time': 1774883082.0, 'created_time': 1772545556.878691, 'last_price_update_time': 1774809745.084321}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD43211') HTTP/1.1" 204 0
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for BD76424: 2
2026-03-29 18:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424
2026-03-29 18:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 252a5b09-c158-5aa1-88db-cb4a031271d7 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 252a5b09-c158-5aa1-88db-cb4a031271d7 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 252a5b09-c158-5aa1-88db-cb4a031271d7, identifier: BD76424
2026-03-29 18:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424
2026-03-29 18:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424
2026-03-29 18:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 252a5b09-c158-5aa1-88db-cb4a031271d7 with identifier: BD76424 to the API
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-30T15:34:51Z',
'fuel_type': 'petrol',
'id': '252a5b09-c158-5aa1-88db-cb4a031271d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD76424',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 105369,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-21',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2019}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Saving data for BD76424: {'auction_closing_time': 1774884891.0, 'created_time': 1773945748.069152, 'last_price_update_time': 1774809745.471066}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD76424') HTTP/1.1" 204 0
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for KZ71563: 0
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for SL45023: 0
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for LK80095: 0
2026-03-29 18:42:25 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Scrape type for CM30450: 2
2026-03-29 18:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-03-29 18:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2e181e-743a-5f4b-9171-9e0ec8f50619 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db2e181e-743a-5f4b-9171-9e0ec8f50619 with scrape type 2
2026-03-29 18:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2e181e-743a-5f4b-9171-9e0ec8f50619, identifier: CM30450
2026-03-29 18:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-03-29 18:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450
2026-03-29 18:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2e181e-743a-5f4b-9171-9e0ec8f50619 with identifier: CM30450 to the API
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:30:45Z',
'fuel_type': 'diesel',
'id': 'db2e181e-743a-5f4b-9171-9e0ec8f50619',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM30450',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 156152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-30',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2020}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-29 18:42:25 [auto1.de] INFO: Saving data for CM30450: {'auction_closing_time': 1774884645.0, 'created_time': 1774002320.389249, 'last_price_update_time': 1774809745.97309}
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM30450') HTTP/1.1" 204 0
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Scrape type for YR75545: 0
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Scrape type for HA14963: 0
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Scrape type for GX32204: 2
2026-03-29 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204
2026-03-29 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30df28bb-8bda-51c7-b7c1-07c6ff626245 with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30df28bb-8bda-51c7-b7c1-07c6ff626245 with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30df28bb-8bda-51c7-b7c1-07c6ff626245, identifier: GX32204
2026-03-29 18:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204
2026-03-29 18:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204
2026-03-29 18:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30df28bb-8bda-51c7-b7c1-07c6ff626245 with identifier: GX32204 to the API
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:40Z',
'fuel_type': 'diesel',
'id': '30df28bb-8bda-51c7-b7c1-07c6ff626245',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX32204',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 121240,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-08',
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Saving data for GX32204: {'auction_closing_time': 1774883500.0, 'created_time': 1774033971.482983, 'last_price_update_time': 1774809746.562042}
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX32204') HTTP/1.1" 204 0
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-29 18:42:26 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-29 18:42:26 [auto1.de] INFO: Scrape type for BP38143: 2
2026-03-29 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-29 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4c00af-b029-594d-889c-17500baaea76 with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec4c00af-b029-594d-889c-17500baaea76 with scrape type 2
2026-03-29 18:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec4c00af-b029-594d-889c-17500baaea76, identifier: BP38143
2026-03-29 18:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-29 18:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-29 18:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143 to the API
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:47:16Z',
'fuel_type': 'petrol',
'id': 'ec4c00af-b029-594d-889c-17500baaea76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP38143',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 72173,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2016}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Saving data for BP38143: {'auction_closing_time': 1774885636.0, 'created_time': 1773138586.995264, 'last_price_update_time': 1774809747.013217}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP38143') HTTP/1.1" 204 0
2026-03-29 18:42:27 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for UA25928: 2
2026-03-29 18:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-29 18:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62b3fb57-2898-58b7-b0a6-a3d5520b4883, identifier: UA25928
2026-03-29 18:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-29 18:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928
2026-03-29 18:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62b3fb57-2898-58b7-b0a6-a3d5520b4883 with identifier: UA25928 to the API
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:10:11Z',
'fuel_type': 'petrol',
'id': '62b3fb57-2898-58b7-b0a6-a3d5520b4883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA25928',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 131658,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-10-30',
'seller_name': None,
'title': 'BMW 3er 325i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2006}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Saving data for UA25928: {'auction_closing_time': 1774883411.0, 'created_time': 1774522813.919324, 'last_price_update_time': 1774809747.426174}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA25928') HTTP/1.1" 204 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for HB57575: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for GT24864: 2
2026-03-29 18:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-29 18:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d78ae10-c22e-5193-8245-4e06fddae7d3 with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d78ae10-c22e-5193-8245-4e06fddae7d3 with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d78ae10-c22e-5193-8245-4e06fddae7d3, identifier: GT24864
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-29 18:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-29 18:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864
2026-03-29 18:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d78ae10-c22e-5193-8245-4e06fddae7d3 with identifier: GT24864 to the API
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:34Z',
'fuel_type': 'petrol',
'id': '8d78ae10-c22e-5193-8245-4e06fddae7d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT24864',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 38158,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-17',
'seller_name': None,
'title': 'Audi Q2 35 TFSI advanced',
'transmission': 'automatic',
'trim': 'advanced',
'year': 2021}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Saving data for GT24864: {'auction_closing_time': 1774886254.0, 'created_time': 1774522648.065157, 'last_price_update_time': 1774809747.838156}
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT24864') HTTP/1.1" 204 0
2026-03-29 18:42:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for UF58190: 0
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-29 18:42:27 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-29 18:42:27 [auto1.de] INFO: Scrape type for ZA93244: 2
2026-03-29 18:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244
2026-03-29 18:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6ee588-5e0b-5011-979b-c0fe9064406c with scrape type 2
2026-03-29 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b6ee588-5e0b-5011-979b-c0fe9064406c with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b6ee588-5e0b-5011-979b-c0fe9064406c, identifier: ZA93244
2026-03-29 18:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244
2026-03-29 18:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244
2026-03-29 18:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b6ee588-5e0b-5011-979b-c0fe9064406c with identifier: ZA93244 to the API
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 65,
'expiration_date': '2026-03-30T15:59:52Z',
'fuel_type': 'petrol',
'id': '9b6ee588-5e0b-5011-979b-c0fe9064406c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA93244',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 102521,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-15',
'seller_name': None,
'title': 'Ford Fiesta 1.0 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2016}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Saving data for ZA93244: {'auction_closing_time': 1774886392.0, 'created_time': 1774636768.764003, 'last_price_update_time': 1774809748.375444}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA93244') HTTP/1.1" 204 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for AL15511: 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for RV42869: 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for TB15164: 2
2026-03-29 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-29 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcbe0df5-f8c1-503e-b8d3-0c5217a51678, identifier: TB15164
2026-03-29 18:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-29 18:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-29 18:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164 to the API
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:21:51Z',
'fuel_type': 'petrol',
'id': 'dcbe0df5-f8c1-503e-b8d3-0c5217a51678',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB15164',
'listing': 'auction',
'make': 'Opel',
'model': 'Adam',
'odometer': 177678,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-01',
'seller_name': None,
'title': 'Opel Adam 1.0 Turbo Slam ecoFlex',
'transmission': 'manual',
'trim': 'Slam ecoFlex',
'year': 2016}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Saving data for TB15164: {'auction_closing_time': 1774884111.0, 'created_time': 1773401242.008756, 'last_price_update_time': 1774809748.884334}
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB15164') HTTP/1.1" 204 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for WM92203: 0
2026-03-29 18:42:28 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK87306%27 HTTP/1.1" 200 None
2026-03-29 18:42:28 [auto1.de] INFO: Scrape type for NK87306: 2
2026-03-29 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306
2026-03-29 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d39253-9880-5844-83b8-106224df9ffb with scrape type 2
2026-03-29 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d39253-9880-5844-83b8-106224df9ffb with scrape type 2
2026-03-29 18:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9d39253-9880-5844-83b8-106224df9ffb, identifier: NK87306
2026-03-29 18:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306
2026-03-29 18:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306
2026-03-29 18:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9d39253-9880-5844-83b8-106224df9ffb with identifier: NK87306 to the API
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:27:40Z',
'fuel_type': 'diesel',
'id': 'b9d39253-9880-5844-83b8-106224df9ffb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK87306',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 232200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-20',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2016}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK87306%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Saving data for NK87306: {'auction_closing_time': 1774884460.0, 'created_time': 1774723178.711827, 'last_price_update_time': 1774809749.345154}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK87306') HTTP/1.1" 204 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for CN06101: 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for DG36538: 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for PS82435: 2
2026-03-29 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-29 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d46900-c4d0-596f-bf3c-3292316c6c06 with scrape type 2
2026-03-29 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d46900-c4d0-596f-bf3c-3292316c6c06 with scrape type 2
2026-03-29 18:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83d46900-c4d0-596f-bf3c-3292316c6c06, identifier: PS82435
2026-03-29 18:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-29 18:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-29 18:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435 to the API
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:22:33Z',
'fuel_type': 'diesel',
'id': '83d46900-c4d0-596f-bf3c-3292316c6c06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82435',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 111544,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-05',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Saving data for PS82435: {'auction_closing_time': 1774884153.0, 'created_time': 1773383897.094769, 'last_price_update_time': 1774809749.941042}
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS82435') HTTP/1.1" 204 0
2026-03-29 18:42:29 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-29 18:42:29 [auto1.de] INFO: Scrape type for KG20268: 2
2026-03-29 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-29 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c0292a8-1cdd-5161-9343-12aaca46971a with scrape type 2
2026-03-29 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c0292a8-1cdd-5161-9343-12aaca46971a with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c0292a8-1cdd-5161-9343-12aaca46971a, identifier: KG20268
2026-03-29 18:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-29 18:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-29 18:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268 to the API
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:19:36Z',
'fuel_type': 'petrol',
'id': '1c0292a8-1cdd-5161-9343-12aaca46971a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG20268',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 48309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-30',
'seller_name': None,
'title': 'Fiat 500 1.2 Mirror',
'transmission': 'manual',
'trim': 'Mirror',
'year': 2017}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Saving data for KG20268: {'auction_closing_time': 1774883976.0, 'created_time': 1773401724.32914, 'last_price_update_time': 1774809750.418707}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG20268') HTTP/1.1" 204 0
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Scrape type for UZ90215: 2
2026-03-29 18:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-29 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe053552-3315-56c8-bbd8-1bc54e34e7ae with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe053552-3315-56c8-bbd8-1bc54e34e7ae with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe053552-3315-56c8-bbd8-1bc54e34e7ae, identifier: UZ90215
2026-03-29 18:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-29 18:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-29 18:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215 to the API
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:26:53Z',
'fuel_type': 'petrol',
'id': 'fe053552-3315-56c8-bbd8-1bc54e34e7ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ90215',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 999999,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-08',
'seller_name': None,
'title': 'BMW X4 xDrive 30i xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Saving data for UZ90215: {'auction_closing_time': 1774884413.0, 'created_time': 1773774006.999903, 'last_price_update_time': 1774809750.873146}
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ90215') HTTP/1.1" 204 0
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Scrape type for HU93536: 0
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Scrape type for GF09029: 0
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-29 18:42:30 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-29 18:42:30 [auto1.de] INFO: Scrape type for AE03495: 2
2026-03-29 18:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-29 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with scrape type 2
2026-03-29 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with scrape type 2
2026-03-29 18:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4, identifier: AE03495
2026-03-29 18:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-29 18:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495
2026-03-29 18:42:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4 with identifier: AE03495 to the API
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:36:12Z',
'fuel_type': 'diesel',
'id': '1ab6d7dc-dc45-5e9d-87ef-c5647f7686c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE03495',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 133856,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-23',
'seller_name': None,
'title': 'Audi A5 Sportback 40 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-29 18:42:31 [auto1.de] INFO: Saving data for AE03495: {'auction_closing_time': 1774884972.0, 'created_time': 1774521494.378935, 'last_price_update_time': 1774809751.617041}
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE03495') HTTP/1.1" 204 0
2026-03-29 18:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-29 18:42:31 [auto1.de] INFO: Scrape type for PZ10151: 0
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-29 18:42:31 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-29 18:42:31 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-29 18:42:31 [auto1.de] INFO: Scrape type for BP24575: 2
2026-03-29 18:42:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-29 18:42:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with scrape type 2
2026-03-29 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with scrape type 2
2026-03-29 18:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d, identifier: BP24575
2026-03-29 18:42:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-29 18:42:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-29 18:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575 to the API
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:43Z',
'fuel_type': 'diesel',
'id': 'c3f1334e-fde6-59cd-b2cc-f9f257cfa26d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP24575',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 176105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-02',
'seller_name': None,
'title': 'MINI Countryman Cooper D ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2015}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Saving data for BP24575: {'auction_closing_time': 1774883323.0, 'created_time': 1774608611.421232, 'last_price_update_time': 1774809752.292256}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP24575') HTTP/1.1" 204 0
2026-03-29 18:42:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for VY22593: 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for LG87332: 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Scrape type for SW77788: 2
2026-03-29 18:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-29 18:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eab29c30-b714-5e56-9f83-942f66d0503f with scrape type 2
2026-03-29 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eab29c30-b714-5e56-9f83-942f66d0503f with scrape type 2
2026-03-29 18:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eab29c30-b714-5e56-9f83-942f66d0503f, identifier: SW77788
2026-03-29 18:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-29 18:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-29 18:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788 to the API
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:12:24Z',
'fuel_type': 'diesel',
'id': 'eab29c30-b714-5e56-9f83-942f66d0503f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW77788',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 268536,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-31',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-29 18:42:32 [auto1.de] INFO: Saving data for SW77788: {'auction_closing_time': 1774883544.0, 'created_time': 1774292264.939093, 'last_price_update_time': 1774809752.872778}
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW77788') HTTP/1.1" 204 0
2026-03-29 18:42:32 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-29 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Scrape type for XT42199: 2
2026-03-29 18:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-29 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfccc22-160e-5798-9837-1f036baa35e0 with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bfccc22-160e-5798-9837-1f036baa35e0 with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bfccc22-160e-5798-9837-1f036baa35e0, identifier: XT42199
2026-03-29 18:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-29 18:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-29 18:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199 to the API
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:59:30Z',
'fuel_type': 'diesel',
'id': '7bfccc22-160e-5798-9837-1f036baa35e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT42199',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 149885,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-18',
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
'transmission': 'automatic',
'trim': 'Sports-Line AWD',
'year': 2015}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Saving data for XT42199: {'auction_closing_time': 1774886370.0, 'created_time': 1774608213.149039, 'last_price_update_time': 1774809753.433932}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT42199') HTTP/1.1" 204 0
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Scrape type for JA64656: 2
2026-03-29 18:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-29 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 971d896d-b74a-5e01-b383-eff0db2ce72b with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 971d896d-b74a-5e01-b383-eff0db2ce72b with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 971d896d-b74a-5e01-b383-eff0db2ce72b, identifier: JA64656
2026-03-29 18:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-29 18:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-29 18:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656 to the API
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:33:32Z',
'fuel_type': 'petrol',
'id': '971d896d-b74a-5e01-b383-eff0db2ce72b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA64656',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 113122,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-08',
'seller_name': None,
'title': 'BMW 3er 328i',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Saving data for JA64656: {'auction_closing_time': 1774884812.0, 'created_time': 1773686205.133328, 'last_price_update_time': 1774809753.938103}
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA64656') HTTP/1.1" 204 0
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-29 18:42:33 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM72626%27 HTTP/1.1" 200 None
2026-03-29 18:42:33 [auto1.de] INFO: Scrape type for RM72626: 2
2026-03-29 18:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626
2026-03-29 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fd10a1-15e7-5bed-9eaf-14872445ed25 with scrape type 2
2026-03-29 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20fd10a1-15e7-5bed-9eaf-14872445ed25 with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20fd10a1-15e7-5bed-9eaf-14872445ed25, identifier: RM72626
2026-03-29 18:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626
2026-03-29 18:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626
2026-03-29 18:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20fd10a1-15e7-5bed-9eaf-14872445ed25 with identifier: RM72626 to the API
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:21:56Z',
'fuel_type': 'diesel',
'id': '20fd10a1-15e7-5bed-9eaf-14872445ed25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM72626',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 179216,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-30',
'seller_name': None,
'title': 'Opel Vivaro 2.0 CDTI Kasten L1H1 2,7t',
'transmission': 'manual',
'trim': 'Kasten L1H1 2,7t',
'year': 2012}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM72626%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Saving data for RM72626: {'auction_closing_time': 1774884116.0, 'created_time': 1773381169.44772, 'last_price_update_time': 1774809754.408733}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM72626') HTTP/1.1" 204 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for XS43563: 2
2026-03-29 18:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-29 18:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f74628-013a-543b-97f9-e050c19bc70e with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f74628-013a-543b-97f9-e050c19bc70e with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f74628-013a-543b-97f9-e050c19bc70e, identifier: XS43563
2026-03-29 18:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-29 18:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563
2026-03-29 18:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f74628-013a-543b-97f9-e050c19bc70e with identifier: XS43563 to the API
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:32:00Z',
'fuel_type': 'petrol',
'id': '81f74628-013a-543b-97f9-e050c19bc70e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS43563',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 92183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-12',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2017}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Saving data for XS43563: {'auction_closing_time': 1774884720.0, 'created_time': 1774522020.128607, 'last_price_update_time': 1774809754.813458}
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS43563') HTTP/1.1" 204 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for VB65040: 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for DR69108: 0
2026-03-29 18:42:34 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-29 18:42:34 [auto1.de] INFO: Scrape type for GT81151: 2
2026-03-29 18:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-29 18:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd25ecaa-5dd7-5ac7-bd02-669695c638bb with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd25ecaa-5dd7-5ac7-bd02-669695c638bb with scrape type 2
2026-03-29 18:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd25ecaa-5dd7-5ac7-bd02-669695c638bb, identifier: GT81151
2026-03-29 18:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-29 18:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151
2026-03-29 18:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd25ecaa-5dd7-5ac7-bd02-669695c638bb with identifier: GT81151 to the API
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:29:52Z',
'fuel_type': 'diesel',
'id': 'cd25ecaa-5dd7-5ac7-bd02-669695c638bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT81151',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 266127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2016}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Saving data for GT81151: {'auction_closing_time': 1774884592.0, 'created_time': 1773945997.534217, 'last_price_update_time': 1774809755.250232}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT81151') HTTP/1.1" 204 0
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Scrape type for UH95210: 2
2026-03-29 18:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210
2026-03-29 18:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20eb71d-629e-5e70-a761-54561d5e66f0 with scrape type 2
2026-03-29 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20eb71d-629e-5e70-a761-54561d5e66f0 with scrape type 2
2026-03-29 18:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b20eb71d-629e-5e70-a761-54561d5e66f0, identifier: UH95210
2026-03-29 18:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210
2026-03-29 18:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210
2026-03-29 18:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b20eb71d-629e-5e70-a761-54561d5e66f0 with identifier: UH95210 to the API
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:43:20Z',
'fuel_type': 'diesel',
'id': 'b20eb71d-629e-5e70-a761-54561d5e66f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH95210',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 151560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-24',
'seller_name': None,
'title': 'BMW 5er 535d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Saving data for UH95210: {'auction_closing_time': 1774885400.0, 'created_time': 1774350587.324075, 'last_price_update_time': 1774809755.736471}
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH95210') HTTP/1.1" 204 0
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Scrape type for FE02336: 0
2026-03-29 18:42:35 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-29 18:42:35 [auto1.de] INFO: Scrape type for MJ48017: 2
2026-03-29 18:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-29 18:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with scrape type 2
2026-03-29 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with scrape type 2
2026-03-29 18:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3, identifier: MJ48017
2026-03-29 18:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-29 18:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-29 18:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017 to the API
2026-03-29 18:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:32:43Z',
'fuel_type': 'petrol',
'id': 'c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ48017',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 58100,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-07',
'seller_name': None,
'title': 'Kia XCeed 1.5 TGDI Xdition',
'transmission': 'automatic',
'trim': 'Xdition',
'year': 2021}
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-29 18:42:36 [auto1.de] INFO: Saving data for MJ48017: {'auction_closing_time': 1774884763.0, 'created_time': 1773304914.987203, 'last_price_update_time': 1774809756.207343}
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ48017') HTTP/1.1" 204 0
2026-03-29 18:42:36 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-29 18:42:36 [auto1.de] INFO: Scrape type for YK99785: 2
2026-03-29 18:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-29 18:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75fcfc91-0954-57fe-9278-05d171145ec5 with scrape type 2
2026-03-29 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75fcfc91-0954-57fe-9278-05d171145ec5 with scrape type 2
2026-03-29 18:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75fcfc91-0954-57fe-9278-05d171145ec5, identifier: YK99785
2026-03-29 18:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-29 18:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-29 18:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785 to the API
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:20:39Z',
'fuel_type': 'petrol',
'id': '75fcfc91-0954-57fe-9278-05d171145ec5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK99785',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 56197,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-02',
'seller_name': None,
'title': 'Skoda Yeti 1.2 TSI Joy',
'transmission': 'manual',
'trim': 'Joy',
'year': 2016}
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-29 18:42:36 [auto1.de] INFO: Saving data for YK99785: {'auction_closing_time': 1774884039.0, 'created_time': 1773308107.320436, 'last_price_update_time': 1774809756.637097}
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK99785') HTTP/1.1" 204 0
2026-03-29 18:42:36 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-29 18:42:36 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-29 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:36 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:36 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-29 18:42:36 [auto1.de] INFO: Scrape type for FG55582: 2
2026-03-29 18:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582
2026-03-29 18:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a18a460-e9df-5093-9042-55aa5d39d04b with scrape type 2
2026-03-29 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a18a460-e9df-5093-9042-55aa5d39d04b with scrape type 2
2026-03-29 18:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a18a460-e9df-5093-9042-55aa5d39d04b, identifier: FG55582
2026-03-29 18:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582
2026-03-29 18:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582
2026-03-29 18:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a18a460-e9df-5093-9042-55aa5d39d04b with identifier: FG55582 to the API
2026-03-29 18:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:17:20Z',
'fuel_type': 'petrol',
'id': '0a18a460-e9df-5093-9042-55aa5d39d04b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG55582',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 108085,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-05',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2010}
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-29 18:42:37 [auto1.de] INFO: Saving data for FG55582: {'auction_closing_time': 1774883840.0, 'created_time': 1774636728.053953, 'last_price_update_time': 1774809757.132833}
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG55582') HTTP/1.1" 204 0
2026-03-29 18:42:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-29 18:42:37 [auto1.de] INFO: Scrape type for MG94250: 2
2026-03-29 18:42:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-29 18:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with scrape type 2
2026-03-29 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with scrape type 2
2026-03-29 18:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bc1cd76-52db-5e6c-9536-fd3ed2009216, identifier: MG94250
2026-03-29 18:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-29 18:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-29 18:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250 to the API
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:32:52Z',
'fuel_type': 'petrol',
'id': '6bc1cd76-52db-5e6c-9536-fd3ed2009216',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG94250',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 183656,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-26',
'seller_name': None,
'title': 'Citroen C3 1.4 VTR',
'transmission': 'manual',
'trim': 'VTR',
'year': 2007}
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-29 18:42:37 [auto1.de] INFO: Saving data for MG94250: {'auction_closing_time': 1774884772.0, 'created_time': 1773812139.32712, 'last_price_update_time': 1774809757.589657}
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG94250') HTTP/1.1" 204 0
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-29 18:42:37 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-29 18:42:37 [auto1.de] INFO: Scrape type for CH51511: 2
2026-03-29 18:42:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-29 18:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738521a3-734e-5a8e-b4c5-86f182dcd005 with scrape type 2
2026-03-29 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738521a3-734e-5a8e-b4c5-86f182dcd005 with scrape type 2
2026-03-29 18:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 738521a3-734e-5a8e-b4c5-86f182dcd005, identifier: CH51511
2026-03-29 18:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-29 18:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-29 18:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511 to the API
2026-03-29 18:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:29:33Z',
'fuel_type': 'diesel',
'id': '738521a3-734e-5a8e-b4c5-86f182dcd005',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH51511',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 165863,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC Avantgarde',
'transmission': 'manual',
'trim': 'T BlueTEC Avantgarde',
'year': 2017}
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-29 18:42:38 [auto1.de] INFO: Saving data for CH51511: {'auction_closing_time': 1774884573.0, 'created_time': 1774262488.817953, 'last_price_update_time': 1774809758.131487}
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH51511') HTTP/1.1" 204 0
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-29 18:42:38 [auto1.de] INFO: Scrape type for GR34047: 0
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-29 18:42:38 [auto1.de] INFO: Scrape type for GE71981: 2
2026-03-29 18:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-29 18:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343a34c2-cb4d-5c02-a9c5-767603466e49 with scrape type 2
2026-03-29 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343a34c2-cb4d-5c02-a9c5-767603466e49 with scrape type 2
2026-03-29 18:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 343a34c2-cb4d-5c02-a9c5-767603466e49, identifier: GE71981
2026-03-29 18:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-29 18:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-29 18:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981 to the API
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:20:00Z',
'fuel_type': 'petrol',
'id': '343a34c2-cb4d-5c02-a9c5-767603466e49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE71981',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Aveo',
'odometer': 110771,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-30',
'seller_name': None,
'title': 'Chevrolet Aveo 1.6 LTZ',
'transmission': 'manual',
'trim': 'LTZ',
'year': 2012}
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-29 18:42:38 [auto1.de] INFO: Saving data for GE71981: {'auction_closing_time': 1774884000.0, 'created_time': 1773775126.334973, 'last_price_update_time': 1774809758.605982}
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE71981') HTTP/1.1" 204 0
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-29 18:42:38 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-29 18:42:38 [auto1.de] INFO: Scrape type for KB32538: 2
2026-03-29 18:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-29 18:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 071cb01b-3ab6-5913-99bf-5cfcde11d767 with scrape type 2
2026-03-29 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 071cb01b-3ab6-5913-99bf-5cfcde11d767 with scrape type 2
2026-03-29 18:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 071cb01b-3ab6-5913-99bf-5cfcde11d767, identifier: KB32538
2026-03-29 18:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-29 18:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538
2026-03-29 18:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 071cb01b-3ab6-5913-99bf-5cfcde11d767 with identifier: KB32538 to the API
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:17:43Z',
'fuel_type': 'petrol',
'id': '071cb01b-3ab6-5913-99bf-5cfcde11d767',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB32538',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 113398,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-17',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBoost Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2017}
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Saving data for KB32538: {'auction_closing_time': 1774883863.0, 'created_time': 1774522249.387904, 'last_price_update_time': 1774809759.032036}
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB32538') HTTP/1.1" 204 0
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Scrape type for FR65686: 0
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Scrape type for RX17782: 0
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Scrape type for SN13100: 2
2026-03-29 18:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100
2026-03-29 18:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5edc0772-3a9a-52f2-9586-fe59203fabc7 with scrape type 2
2026-03-29 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5edc0772-3a9a-52f2-9586-fe59203fabc7 with scrape type 2
2026-03-29 18:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5edc0772-3a9a-52f2-9586-fe59203fabc7, identifier: SN13100
2026-03-29 18:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100
2026-03-29 18:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100
2026-03-29 18:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5edc0772-3a9a-52f2-9586-fe59203fabc7 with identifier: SN13100 to the API
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:55:42Z',
'fuel_type': 'petrol',
'id': '5edc0772-3a9a-52f2-9586-fe59203fabc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN13100',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 195096,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-09-30',
'seller_name': None,
'title': 'BMW 3er 318i',
'transmission': 'manual',
'trim': '',
'year': 2001}
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Saving data for SN13100: {'auction_closing_time': 1774886142.0, 'created_time': 1773381580.527758, 'last_price_update_time': 1774809759.555255}
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN13100') HTTP/1.1" 204 0
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Scrape type for SV05588: 2
2026-03-29 18:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588
2026-03-29 18:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f75396-3e9a-5b99-8376-69ae72c8a864 with scrape type 2
2026-03-29 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07f75396-3e9a-5b99-8376-69ae72c8a864 with scrape type 2
2026-03-29 18:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07f75396-3e9a-5b99-8376-69ae72c8a864, identifier: SV05588
2026-03-29 18:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588
2026-03-29 18:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588
2026-03-29 18:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07f75396-3e9a-5b99-8376-69ae72c8a864 with identifier: SV05588 to the API
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:19:18Z',
'fuel_type': 'diesel',
'id': '07f75396-3e9a-5b99-8376-69ae72c8a864',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV05588',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Transporter',
'odometer': 64815,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-17',
'seller_name': None,
'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten EcoProfi FWD',
'transmission': 'manual',
'trim': 'Kasten EcoProfi FWD',
'year': 2020}
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Saving data for SV05588: {'auction_closing_time': 1774883958.0, 'created_time': 1774636644.439762, 'last_price_update_time': 1774809759.947046}
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV05588') HTTP/1.1" 204 0
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-29 18:42:39 [auto1.de] INFO: Scrape type for VR85495: 0
2026-03-29 18:42:39 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-29 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-29 18:42:40 [auto1.de] INFO: Scrape type for MW87907: 0
2026-03-29 18:42:40 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-29 18:42:40 [auto1.de] INFO: Scrape type for RE51747: 2
2026-03-29 18:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-29 18:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with scrape type 2
2026-03-29 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with scrape type 2
2026-03-29 18:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353, identifier: RE51747
2026-03-29 18:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-29 18:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-29 18:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747 to the API
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:53:47Z',
'fuel_type': 'petrol',
'id': '81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE51747',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 183217,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-28',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-29 18:42:40 [auto1.de] INFO: Saving data for RE51747: {'auction_closing_time': 1774886027.0, 'created_time': 1773812130.262438, 'last_price_update_time': 1774809760.422039}
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE51747') HTTP/1.1" 204 0
2026-03-29 18:42:40 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-29 18:42:40 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-29 18:42:40 [auto1.de] INFO: Scrape type for XW64157: 0
2026-03-29 18:42:40 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-29 18:42:40 [auto1.de] INFO: Scrape type for RT05555: 0
2026-03-29 18:42:40 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-29 18:42:40 [auto1.de] INFO: Scrape type for MM04767: 2
2026-03-29 18:42:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-29 18:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42669363-fad3-5798-b87e-c2fb0ecf5665 with scrape type 2
2026-03-29 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42669363-fad3-5798-b87e-c2fb0ecf5665 with scrape type 2
2026-03-29 18:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42669363-fad3-5798-b87e-c2fb0ecf5665, identifier: MM04767
2026-03-29 18:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-29 18:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-29 18:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767 to the API
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:53:27Z',
'fuel_type': 'petrol',
'id': '42669363-fad3-5798-b87e-c2fb0ecf5665',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM04767',
'listing': 'auction',
'make': 'Fiat',
'model': 'Grande Punto',
'odometer': 115141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-31',
'seller_name': None,
'title': 'Fiat Grande Punto 1.2 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-29 18:42:40 [auto1.de] INFO: Saving data for MM04767: {'auction_closing_time': 1774886007.0, 'created_time': 1774294718.697982, 'last_price_update_time': 1774809760.899125}
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM04767') HTTP/1.1" 204 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for JZ77748: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for HC69827: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for TH50819: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for XY47977: 2
2026-03-29 18:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-29 18:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with scrape type 2
2026-03-29 18:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with scrape type 2
2026-03-29 18:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366, identifier: XY47977
2026-03-29 18:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-29 18:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-29 18:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977 to the API
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:36:00Z',
'fuel_type': 'petrol',
'id': '3ada0154-2dce-5ea5-ac7f-71d4a6dcc366',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY47977',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 157399,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-12',
'seller_name': None,
'title': 'Audi A3 Sportback 1.2 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2012}
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Saving data for XY47977: {'auction_closing_time': 1774884960.0, 'created_time': 1774607933.858252, 'last_price_update_time': 1774809761.530444}
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY47977') HTTP/1.1" 204 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-29 18:42:41 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for VV79476: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for HY86490: 0
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-29 18:42:41 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Scrape type for AG24612: 2
2026-03-29 18:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-29 18:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with scrape type 2
2026-03-29 18:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with scrape type 2
2026-03-29 18:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc, identifier: AG24612
2026-03-29 18:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-29 18:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612
2026-03-29 18:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83c72ebc-8b5c-5269-8ab5-656ab2f051bc with identifier: AG24612 to the API
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:16Z',
'fuel_type': 'diesel',
'id': '83c72ebc-8b5c-5269-8ab5-656ab2f051bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG24612',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 204163,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-04',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 d Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2021}
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-29 18:42:41 [auto1.de] INFO: Saving data for AG24612: {'auction_closing_time': 1774883776.0, 'created_time': 1774521374.437965, 'last_price_update_time': 1774809761.979377}
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG24612') HTTP/1.1" 204 0
2026-03-29 18:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for BK73701: 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for TA42625: 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for JC63536: 2
2026-03-29 18:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-29 18:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d, identifier: JC63536
2026-03-29 18:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-29 18:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-29 18:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536 to the API
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:27:30Z',
'fuel_type': 'petrol',
'id': '0c7f6d67-bd1a-5d06-9127-4fe4e76a209d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC63536',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 205020,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-10-15',
'seller_name': None,
'title': 'BMW 5er 520i',
'transmission': 'manual',
'trim': '',
'year': 2002}
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Saving data for JC63536: {'auction_closing_time': 1774884450.0, 'created_time': 1773571978.063143, 'last_price_update_time': 1774809762.560034}
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC63536') HTTP/1.1" 204 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for NV55096: 0
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-29 18:42:42 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-29 18:42:42 [auto1.de] INFO: Scrape type for HY59950: 2
2026-03-29 18:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-29 18:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e06db99-904f-5866-97f1-b18f223595fa with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e06db99-904f-5866-97f1-b18f223595fa with scrape type 2
2026-03-29 18:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e06db99-904f-5866-97f1-b18f223595fa, identifier: HY59950
2026-03-29 18:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-29 18:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-29 18:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950 to the API
2026-03-29 18:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:15:52Z',
'fuel_type': 'petrol',
'id': '1e06db99-904f-5866-97f1-b18f223595fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY59950',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 36782,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-06',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2023}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Saving data for HY59950: {'auction_closing_time': 1774883752.0, 'created_time': 1774607780.063269, 'last_price_update_time': 1774809763.118206}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY59950') HTTP/1.1" 204 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for JE47018: 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for KU99299: 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for AJ13004: 2
2026-03-29 18:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-29 18:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2650f5b-4934-5021-821b-9935d661cf49 with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2650f5b-4934-5021-821b-9935d661cf49 with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2650f5b-4934-5021-821b-9935d661cf49, identifier: AJ13004
2026-03-29 18:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-29 18:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-29 18:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004 to the API
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:12:23Z',
'fuel_type': 'petrol',
'id': 'd2650f5b-4934-5021-821b-9935d661cf49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ13004',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 125993,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'Peugeot 208 1.2 e-VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Saving data for AJ13004: {'auction_closing_time': 1774883543.0, 'created_time': 1772543367.94763, 'last_price_update_time': 1774809763.578067}
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ13004') HTTP/1.1" 204 0
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-29 18:42:43 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-29 18:42:43 [auto1.de] INFO: Scrape type for TN35459: 2
2026-03-29 18:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-29 18:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with scrape type 2
2026-03-29 18:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4, identifier: TN35459
2026-03-29 18:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-29 18:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-29 18:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459 to the API
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:14:36Z',
'fuel_type': 'petrol',
'id': '80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN35459',
'listing': 'auction',
'make': 'Mazda',
'model': '323',
'odometer': 80891,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-12-06',
'seller_name': None,
'title': 'Mazda 323 1.6 F Exclusive',
'transmission': 'manual',
'trim': 'F Exclusive',
'year': 2001}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Saving data for TN35459: {'auction_closing_time': 1774883676.0, 'created_time': 1774608570.271162, 'last_price_update_time': 1774809764.094321}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN35459') HTTP/1.1" 204 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for EV46611: 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for MW80784: 2
2026-03-29 18:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-29 18:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2653b174-06e5-50de-887b-c45ebcc68d2b with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2653b174-06e5-50de-887b-c45ebcc68d2b with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2653b174-06e5-50de-887b-c45ebcc68d2b, identifier: MW80784
2026-03-29 18:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-29 18:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-29 18:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784 to the API
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:23:42Z',
'fuel_type': 'diesel',
'id': '2653b174-06e5-50de-887b-c45ebcc68d2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW80784',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo',
'odometer': 121034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-25',
'seller_name': None,
'title': 'Opel Combo 1.6 CDTI Kasten L1H1 2,4t',
'transmission': 'manual',
'trim': 'Kasten L1H1 2,4t',
'year': 2016}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Saving data for MW80784: {'auction_closing_time': 1774884222.0, 'created_time': 1774608363.623562, 'last_price_update_time': 1774809764.5474}
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW80784') HTTP/1.1" 204 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for XF30370: 0
2026-03-29 18:42:44 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-29 18:42:44 [auto1.de] INFO: Scrape type for PK45675: 2
2026-03-29 18:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-29 18:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9927601-b027-57a0-ab5e-d6e4476d9d3a with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9927601-b027-57a0-ab5e-d6e4476d9d3a with scrape type 2
2026-03-29 18:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9927601-b027-57a0-ab5e-d6e4476d9d3a, identifier: PK45675
2026-03-29 18:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-29 18:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675
2026-03-29 18:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9927601-b027-57a0-ab5e-d6e4476d9d3a with identifier: PK45675 to the API
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:15:15Z',
'fuel_type': 'diesel',
'id': 'a9927601-b027-57a0-ab5e-d6e4476d9d3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK45675',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 158328,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-22',
'seller_name': None,
'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2022}
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-29 18:42:45 [auto1.de] INFO: Saving data for PK45675: {'auction_closing_time': 1774883715.0, 'created_time': 1773341079.141209, 'last_price_update_time': 1774809765.098791}
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK45675') HTTP/1.1" 204 0
2026-03-29 18:42:45 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-29 18:42:45 [auto1.de] INFO: Scrape type for TT59921: 2
2026-03-29 18:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-29 18:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd8a982-625c-5cc1-9e30-0472ae648a22 with scrape type 2
2026-03-29 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd8a982-625c-5cc1-9e30-0472ae648a22 with scrape type 2
2026-03-29 18:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd8a982-625c-5cc1-9e30-0472ae648a22, identifier: TT59921
2026-03-29 18:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-29 18:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-29 18:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921 to the API
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:06:02Z',
'fuel_type': 'diesel',
'id': 'acd8a982-625c-5cc1-9e30-0472ae648a22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT59921',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 226844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-07',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-29 18:42:45 [auto1.de] INFO: Saving data for TT59921: {'auction_closing_time': 1774883162.0, 'created_time': 1773687239.829686, 'last_price_update_time': 1774809765.581761}
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT59921') HTTP/1.1" 204 0
2026-03-29 18:42:45 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-29 18:42:45 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-29 18:42:45 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-29 18:42:45 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-29 18:42:45 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-29 18:42:45 [auto1.de] INFO: Scrape type for HA91024: 2
2026-03-29 18:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-29 18:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64602ff-fd85-51d2-909c-91fd23602e31 with scrape type 2
2026-03-29 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64602ff-fd85-51d2-909c-91fd23602e31 with scrape type 2
2026-03-29 18:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f64602ff-fd85-51d2-909c-91fd23602e31, identifier: HA91024
2026-03-29 18:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-29 18:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024
2026-03-29 18:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f64602ff-fd85-51d2-909c-91fd23602e31 with identifier: HA91024 to the API
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:22:39Z',
'fuel_type': 'petrol',
'id': 'f64602ff-fd85-51d2-909c-91fd23602e31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA91024',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 97823,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-23',
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2019}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Saving data for HA91024: {'auction_closing_time': 1774884159.0, 'created_time': 1773426992.937684, 'last_price_update_time': 1774809766.011657}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA91024') HTTP/1.1" 204 0
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Scrape type for KC24735: 2
2026-03-29 18:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735
2026-03-29 18:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2, identifier: KC24735
2026-03-29 18:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735
2026-03-29 18:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735
2026-03-29 18:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c70beb9-612b-56f2-a0c6-a15c442ec3a2 with identifier: KC24735 to the API
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:19:38Z',
'fuel_type': 'petrol',
'id': '7c70beb9-612b-56f2-a0c6-a15c442ec3a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC24735',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 97298,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-26',
'seller_name': None,
'title': 'Hyundai i30 1.4 FIFA World Cup Edition',
'transmission': 'manual',
'trim': 'FIFA World Cup Edition',
'year': 2014}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Saving data for KC24735: {'auction_closing_time': 1774883978.0, 'created_time': 1774636650.200132, 'last_price_update_time': 1774809766.404014}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC24735') HTTP/1.1" 204 0
2026-03-29 18:42:46 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-29 18:42:46 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-29 18:42:46 [auto1.de] INFO: Scrape type for KX98394: 2
2026-03-29 18:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-29 18:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beca0e64-c4a9-5fcd-b4e4-3500af629c35 with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beca0e64-c4a9-5fcd-b4e4-3500af629c35 with scrape type 2
2026-03-29 18:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beca0e64-c4a9-5fcd-b4e4-3500af629c35, identifier: KX98394
2026-03-29 18:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-29 18:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-29 18:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394 to the API
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:32:06Z',
'fuel_type': 'petrol',
'id': 'beca0e64-c4a9-5fcd-b4e4-3500af629c35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX98394',
'listing': 'auction',
'make': 'Kia',
'model': 'Rio',
'odometer': 57974,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-18',
'seller_name': None,
'title': 'Kia Rio 1.2 UEFA Euro 2016',
'transmission': 'manual',
'trim': 'UEFA Euro 2016',
'year': 2016}
2026-03-29 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Saving data for KX98394: {'auction_closing_time': 1774884726.0, 'created_time': 1773772690.331679, 'last_price_update_time': 1774809767.001912}
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX98394') HTTP/1.1" 204 0
2026-03-29 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for PE88968: 2
2026-03-29 18:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-29 18:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77a5f20-5f7c-5084-92de-b0e69f17457e with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e77a5f20-5f7c-5084-92de-b0e69f17457e with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e77a5f20-5f7c-5084-92de-b0e69f17457e, identifier: PE88968
2026-03-29 18:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-29 18:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-29 18:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968 to the API
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-30T15:59:39Z',
'fuel_type': 'diesel',
'id': 'e77a5f20-5f7c-5084-92de-b0e69f17457e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE88968',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 353995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-25',
'seller_name': None,
'title': 'BMW X5 3.0d',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Saving data for PE88968: {'auction_closing_time': 1774886379.0, 'created_time': 1773687900.911489, 'last_price_update_time': 1774809767.501734}
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE88968') HTTP/1.1" 204 0
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for LX71576: 0
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for FG79588: 0
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for AA02117: 0
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-29 18:42:47 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-29 18:42:47 [auto1.de] INFO: Scrape type for ZE79625: 2
2026-03-29 18:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-29 18:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5356c6df-c266-58d6-827d-f52dbfdd28a3 with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5356c6df-c266-58d6-827d-f52dbfdd28a3 with scrape type 2
2026-03-29 18:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5356c6df-c266-58d6-827d-f52dbfdd28a3, identifier: ZE79625
2026-03-29 18:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-29 18:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-29 18:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625 to the API
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:22:20Z',
'fuel_type': 'petrol',
'id': '5356c6df-c266-58d6-827d-f52dbfdd28a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE79625',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 113996,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-10',
'seller_name': None,
'title': 'Smart fortwo 0.9 Turbo Basis Prime',
'transmission': 'manual',
'trim': 'Basis Prime',
'year': 2015}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Saving data for ZE79625: {'auction_closing_time': 1774884140.0, 'created_time': 1774607903.553274, 'last_price_update_time': 1774809768.019379}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE79625') HTTP/1.1" 204 0
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Scrape type for PK47596: 2
2026-03-29 18:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-29 18:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baab9b2f-039a-52fb-abf3-07c3f721100b with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baab9b2f-039a-52fb-abf3-07c3f721100b with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baab9b2f-039a-52fb-abf3-07c3f721100b, identifier: PK47596
2026-03-29 18:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-29 18:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596
2026-03-29 18:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baab9b2f-039a-52fb-abf3-07c3f721100b with identifier: PK47596 to the API
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:27:50Z',
'fuel_type': 'petrol',
'id': 'baab9b2f-039a-52fb-abf3-07c3f721100b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK47596',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 137780,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-08',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2011}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Saving data for PK47596: {'auction_closing_time': 1774884470.0, 'created_time': 1773382550.999582, 'last_price_update_time': 1774809768.514166}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK47596') HTTP/1.1" 204 0
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Scrape type for FT31566: 0
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Scrape type for HK24290: 2
2026-03-29 18:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290
2026-03-29 18:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946, identifier: HK24290
2026-03-29 18:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290
2026-03-29 18:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290
2026-03-29 18:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7592c7d5-31cb-5f74-b010-bc6d4d3a0946 with identifier: HK24290 to the API
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:44:42Z',
'fuel_type': 'petrol',
'id': '7592c7d5-31cb-5f74-b010-bc6d4d3a0946',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK24290',
'listing': 'auction',
'make': 'Nissan',
'model': 'Note',
'odometer': 114237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-29',
'seller_name': None,
'title': 'Nissan Note 1.4 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2008}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Saving data for HK24290: {'auction_closing_time': 1774885482.0, 'created_time': 1774636635.648595, 'last_price_update_time': 1774809768.930871}
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK24290') HTTP/1.1" 204 0
2026-03-29 18:42:48 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-29 18:42:48 [auto1.de] INFO: Scrape type for AN45666: 2
2026-03-29 18:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666
2026-03-29 18:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d60ed0-8eae-5229-9976-38e1e369d7f0 with scrape type 2
2026-03-29 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d60ed0-8eae-5229-9976-38e1e369d7f0 with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d60ed0-8eae-5229-9976-38e1e369d7f0, identifier: AN45666
2026-03-29 18:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666
2026-03-29 18:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666
2026-03-29 18:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666 to the API
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:27:44Z',
'fuel_type': 'petrol',
'id': 'f1d60ed0-8eae-5229-9976-38e1e369d7f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN45666',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 75036,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-05',
'seller_name': None,
'title': 'Audi A4 35 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Saving data for AN45666: {'auction_closing_time': 1774884464.0, 'created_time': 1773946574.7995, 'last_price_update_time': 1774809769.417478}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN45666') HTTP/1.1" 204 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for TG58212: 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for LW56593: 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN51648%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for JN51648: 2
2026-03-29 18:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648
2026-03-29 18:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710f1986-f0f9-5004-8090-081117d5ab97 with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710f1986-f0f9-5004-8090-081117d5ab97 with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710f1986-f0f9-5004-8090-081117d5ab97, identifier: JN51648
2026-03-29 18:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648
2026-03-29 18:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648
2026-03-29 18:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710f1986-f0f9-5004-8090-081117d5ab97 with identifier: JN51648 to the API
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:42:23Z',
'fuel_type': 'petrol',
'id': '710f1986-f0f9-5004-8090-081117d5ab97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN51648',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 151287,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-21',
'seller_name': None,
'title': 'BMW 4er 440i Gran Coupé xDrive Sport Line',
'transmission': 'automatic',
'trim': 'xDrive Sport Line',
'year': 2018}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN51648%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Saving data for JN51648: {'auction_closing_time': 1774885343.0, 'created_time': 1774350977.65969, 'last_price_update_time': 1774809769.856219}
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN51648') HTTP/1.1" 204 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for KK98414: 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for WL72774: 0
2026-03-29 18:42:49 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-29 18:42:49 [auto1.de] INFO: Scrape type for LS10539: 2
2026-03-29 18:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-29 18:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd95f7bb-756c-55be-993f-8699e40389ea with scrape type 2
2026-03-29 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd95f7bb-756c-55be-993f-8699e40389ea with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd95f7bb-756c-55be-993f-8699e40389ea, identifier: LS10539
2026-03-29 18:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-29 18:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-29 18:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539 to the API
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:40:00Z',
'fuel_type': 'diesel',
'id': 'bd95f7bb-756c-55be-993f-8699e40389ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS10539',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 228824,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-30',
'seller_name': None,
'title': 'Renault Grand Scenic 1.9 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Saving data for LS10539: {'auction_closing_time': 1774885200.0, 'created_time': 1773686158.237784, 'last_price_update_time': 1774809770.353379}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS10539') HTTP/1.1" 204 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for UY19816: 2
2026-03-29 18:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-29 18:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf72fab7-c316-5479-aa5c-244c6e38af95 with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf72fab7-c316-5479-aa5c-244c6e38af95 with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf72fab7-c316-5479-aa5c-244c6e38af95, identifier: UY19816
2026-03-29 18:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-29 18:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-29 18:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816 to the API
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:00:36Z',
'fuel_type': 'hybrid',
'id': 'bf72fab7-c316-5479-aa5c-244c6e38af95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY19816',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7',
'odometer': 19391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seller_name': None,
'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x2 Rivoli',
'transmission': 'automatic',
'trim': '4x2 Rivoli',
'year': 2022}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Saving data for UY19816: {'auction_closing_time': 1774882836.0, 'created_time': 1773775973.304739, 'last_price_update_time': 1774809770.919414}
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY19816') HTTP/1.1" 204 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for AR60138: 0
2026-03-29 18:42:50 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-29 18:42:50 [auto1.de] INFO: Scrape type for MW91304: 2
2026-03-29 18:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-29 18:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131f0396-9ca0-54c4-9b3e-48194e51609a with scrape type 2
2026-03-29 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 131f0396-9ca0-54c4-9b3e-48194e51609a with scrape type 2
2026-03-29 18:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 131f0396-9ca0-54c4-9b3e-48194e51609a, identifier: MW91304
2026-03-29 18:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-29 18:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-29 18:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304 to the API
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:02:08Z',
'fuel_type': 'petrol',
'id': '131f0396-9ca0-54c4-9b3e-48194e51609a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW91304',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 188416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Saving data for MW91304: {'auction_closing_time': 1774882928.0, 'created_time': 1773303177.190709, 'last_price_update_time': 1774809771.420225}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW91304') HTTP/1.1" 204 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for MX37955: 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Scrape type for AH29152: 2
2026-03-29 18:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-29 18:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49f56615-52d0-5321-b845-93fc1858acd7 with scrape type 2
2026-03-29 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49f56615-52d0-5321-b845-93fc1858acd7 with scrape type 2
2026-03-29 18:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49f56615-52d0-5321-b845-93fc1858acd7, identifier: AH29152
2026-03-29 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-29 18:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-29 18:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152 to the API
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:41:21Z',
'fuel_type': 'diesel',
'id': '49f56615-52d0-5321-b845-93fc1858acd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH29152',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 152409,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-27',
'seller_name': None,
'title': 'Seat Leon 1.6 TDI Style 4Drive',
'transmission': 'manual',
'trim': 'Style 4Drive',
'year': 2015}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-29 18:42:51 [auto1.de] INFO: Saving data for AH29152: {'auction_closing_time': 1774885281.0, 'created_time': 1773861732.855108, 'last_price_update_time': 1774809771.957219}
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH29152') HTTP/1.1" 204 0
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-29 18:42:51 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-29 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Scrape type for LP86406: 0
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-29 18:42:52 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Scrape type for DT28740: 0
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Scrape type for MD93182: 0
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Scrape type for NY19608: 2
2026-03-29 18:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608
2026-03-29 18:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 521f77fb-3b1d-530f-a8ad-866b14571dce with scrape type 2
2026-03-29 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 521f77fb-3b1d-530f-a8ad-866b14571dce with scrape type 2
2026-03-29 18:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 521f77fb-3b1d-530f-a8ad-866b14571dce, identifier: NY19608
2026-03-29 18:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608
2026-03-29 18:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608
2026-03-29 18:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608 to the API
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:18:29Z',
'fuel_type': 'petrol',
'id': '521f77fb-3b1d-530f-a8ad-866b14571dce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY19608',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 4321,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-06',
'seller_name': None,
'title': 'BMW 1er 120 Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2025}
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Saving data for NY19608: {'auction_closing_time': 1774883909.0, 'created_time': 1774510538.443023, 'last_price_update_time': 1774809772.485728}
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY19608') HTTP/1.1" 204 0
2026-03-29 18:42:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:52 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-29 18:42:52 [auto1.de] INFO: Scrape type for FZ44442: 2
2026-03-29 18:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-29 18:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with scrape type 2
2026-03-29 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with scrape type 2
2026-03-29 18:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3, identifier: FZ44442
2026-03-29 18:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-29 18:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-29 18:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442 to the API
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:04:56Z',
'fuel_type': 'hybrid',
'id': 'b6f94a17-29e2-52f3-b9aa-487f9aeff4a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ44442',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 147599,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-01',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Saving data for FZ44442: {'auction_closing_time': 1774883096.0, 'created_time': 1773230339.703605, 'last_price_update_time': 1774809773.099924}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ44442') HTTP/1.1" 204 0
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Scrape type for VE70317: 2
2026-03-29 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-29 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 002e40f6-1d77-52ee-9d5c-990cb80dcea0, identifier: VE70317
2026-03-29 18:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-29 18:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-29 18:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317 to the API
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:09:24Z',
'fuel_type': 'diesel',
'id': '002e40f6-1d77-52ee-9d5c-990cb80dcea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE70317',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 214769,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-14',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Saving data for VE70317: {'auction_closing_time': 1774883364.0, 'created_time': 1774263237.745154, 'last_price_update_time': 1774809773.536573}
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE70317') HTTP/1.1" 204 0
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Scrape type for AY55181: 0
2026-03-29 18:42:53 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-29 18:42:53 [auto1.de] INFO: Scrape type for VL50005: 2
2026-03-29 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-29 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a7ac99b-5265-5002-b0ca-93a2fade221a with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a7ac99b-5265-5002-b0ca-93a2fade221a with scrape type 2
2026-03-29 18:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a7ac99b-5265-5002-b0ca-93a2fade221a, identifier: VL50005
2026-03-29 18:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-29 18:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005
2026-03-29 18:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a7ac99b-5265-5002-b0ca-93a2fade221a with identifier: VL50005 to the API
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:55:16Z',
'fuel_type': 'petrol',
'id': '6a7ac99b-5265-5002-b0ca-93a2fade221a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL50005',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 95969,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-04',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT IQ.DRIVE',
'transmission': 'manual',
'trim': 'IQ.DRIVE',
'year': 2019}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Saving data for VL50005: {'auction_closing_time': 1774886116.0, 'created_time': 1774522563.185792, 'last_price_update_time': 1774809774.034267}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL50005') HTTP/1.1" 204 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for SR18060: 2
2026-03-29 18:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-29 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e94f724-ab19-5609-b614-27fc9bcc81e4 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e94f724-ab19-5609-b614-27fc9bcc81e4 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e94f724-ab19-5609-b614-27fc9bcc81e4, identifier: SR18060
2026-03-29 18:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-29 18:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-29 18:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060 to the API
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:56:37Z',
'fuel_type': 'petrol',
'id': '7e94f724-ab19-5609-b614-27fc9bcc81e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR18060',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 112397,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-29',
'seller_name': None,
'title': 'Opel Meriva 1.8 Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2008}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Saving data for SR18060: {'auction_closing_time': 1774886197.0, 'created_time': 1773306171.017235, 'last_price_update_time': 1774809774.499684}
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR18060') HTTP/1.1" 204 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for DX51383: 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for ZM65960: 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for XR62561: 0
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-29 18:42:54 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-29 18:42:54 [auto1.de] INFO: Scrape type for TL66452: 2
2026-03-29 18:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-29 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with scrape type 2
2026-03-29 18:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97, identifier: TL66452
2026-03-29 18:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-29 18:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-29 18:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452 to the API
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:23:56Z',
'fuel_type': 'diesel',
'id': 'd68b5eeb-0d3d-5433-97c5-03ce07cb2e97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL66452',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 204490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-02',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 320 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2007}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Saving data for TL66452: {'auction_closing_time': 1774884236.0, 'created_time': 1773773226.657106, 'last_price_update_time': 1774809775.012513}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL66452') HTTP/1.1" 204 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for UK28152: 2
2026-03-29 18:42:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-29 18:42:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with scrape type 2
2026-03-29 18:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with scrape type 2
2026-03-29 18:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 070edb50-ff92-5b9f-a8a9-3d4f41aef509, identifier: UK28152
2026-03-29 18:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-29 18:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-29 18:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152 to the API
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:00:20Z',
'fuel_type': 'petrol',
'id': '070edb50-ff92-5b9f-a8a9-3d4f41aef509',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK28152',
'listing': 'auction',
'make': 'Fiat',
'model': 'Grande Punto',
'odometer': 123669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-31',
'seller_name': None,
'title': 'Fiat Grande Punto 1.4 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2009}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Saving data for UK28152: {'auction_closing_time': 1774882820.0, 'created_time': 1774293401.032985, 'last_price_update_time': 1774809775.541851}
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK28152') HTTP/1.1" 204 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG43270%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for BG43270: 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for SX94588: 0
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-29 18:42:55 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-29 18:42:55 [auto1.de] INFO: Scrape type for RU59623: 2
2026-03-29 18:42:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-29 18:42:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8496aa-ce74-5fca-b528-3e32ab32a063 with scrape type 2
2026-03-29 18:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd8496aa-ce74-5fca-b528-3e32ab32a063 with scrape type 2
2026-03-29 18:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd8496aa-ce74-5fca-b528-3e32ab32a063, identifier: RU59623
2026-03-29 18:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-29 18:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-29 18:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623 to the API
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:01Z',
'fuel_type': 'diesel',
'id': 'fd8496aa-ce74-5fca-b528-3e32ab32a063',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU59623',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 249799,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-16',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style BlueMotion Tech',
'transmission': 'manual',
'trim': 'Lounge Sport & Style BlueMotion Tech',
'year': 2015}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Saving data for RU59623: {'auction_closing_time': 1774883341.0, 'created_time': 1774608056.658455, 'last_price_update_time': 1774809776.047341}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU59623') HTTP/1.1" 204 0
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Scrape type for DB64139: 0
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Scrape type for YJ68996: 2
2026-03-29 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996
2026-03-29 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed762c0-1db0-5d02-abf7-8173230a8bcc with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed762c0-1db0-5d02-abf7-8173230a8bcc with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed762c0-1db0-5d02-abf7-8173230a8bcc, identifier: YJ68996
2026-03-29 18:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996
2026-03-29 18:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996
2026-03-29 18:42:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed762c0-1db0-5d02-abf7-8173230a8bcc with identifier: YJ68996 to the API
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:33:27Z',
'fuel_type': 'petrol',
'id': '8ed762c0-1db0-5d02-abf7-8173230a8bcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ68996',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 105732,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-29',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2015}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Saving data for YJ68996: {'auction_closing_time': 1774884807.0, 'created_time': 1774001928.599849, 'last_price_update_time': 1774809776.572618}
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ68996') HTTP/1.1" 204 0
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-29 18:42:56 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-29 18:42:56 [auto1.de] INFO: Scrape type for HX66232: 2
2026-03-29 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-29 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with scrape type 2
2026-03-29 18:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e, identifier: HX66232
2026-03-29 18:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-29 18:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-29 18:42:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232 to the API
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:08:15Z',
'fuel_type': 'petrol',
'id': '08bd7200-f9fb-57ab-9d1a-3f8497e28f1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX66232',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 167261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-26',
'seller_name': None,
'title': 'Seat Leon 1.6 Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2007}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Saving data for HX66232: {'auction_closing_time': 1774883295.0, 'created_time': 1773772791.720956, 'last_price_update_time': 1774809777.074632}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX66232') HTTP/1.1" 204 0
2026-03-29 18:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:42:57 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6740 | hits on page: 40
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for HP10978: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for CW72943: 2
2026-03-29 18:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-29 18:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07916f-c93b-531c-bdf4-70781d17b4de with scrape type 2
2026-03-29 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e07916f-c93b-531c-bdf4-70781d17b4de with scrape type 2
2026-03-29 18:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e07916f-c93b-531c-bdf4-70781d17b4de, identifier: CW72943
2026-03-29 18:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-29 18:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943
2026-03-29 18:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e07916f-c93b-531c-bdf4-70781d17b4de with identifier: CW72943 to the API
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:05:36Z',
'fuel_type': 'petrol',
'id': '1e07916f-c93b-531c-bdf4-70781d17b4de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW72943',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 151047,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-24',
'seller_name': None,
'title': 'Fiat 500C 1.2 Pop',
'transmission': 'manual',
'trim': 'Pop',
'year': 2012}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Saving data for CW72943: {'auction_closing_time': 1774883136.0, 'created_time': 1774521595.197411, 'last_price_update_time': 1774809777.627281}
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW72943') HTTP/1.1" 204 0
2026-03-29 18:42:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for BR64184: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for NX47984: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for GA25019: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for YH89346: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for DV89701: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for CS13699: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for CJ06587: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for SM94434: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for WJ35504: 0
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-29 18:42:57 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-29 18:42:57 [auto1.de] INFO: Scrape type for CL03732: 2
2026-03-29 18:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732
2026-03-29 18:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with scrape type 2
2026-03-29 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0, identifier: CL03732
2026-03-29 18:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732
2026-03-29 18:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732
2026-03-29 18:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0 with identifier: CL03732 to the API
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:52:43Z',
'fuel_type': 'diesel',
'id': '7db81d3a-0ac7-53f3-b6e7-de1c443ec1f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL03732',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 214671,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-08',
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Design Edition',
'transmission': 'manual',
'trim': 'Design Edition',
'year': 2011}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Saving data for CL03732: {'auction_closing_time': 1774885963.0, 'created_time': 1774031765.653242, 'last_price_update_time': 1774809778.291787}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL03732') HTTP/1.1" 204 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for ER72643: 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for PX80115: 2
2026-03-29 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-29 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7611aa3f-9b4b-59d1-8b74-402dac8441ea with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7611aa3f-9b4b-59d1-8b74-402dac8441ea with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7611aa3f-9b4b-59d1-8b74-402dac8441ea, identifier: PX80115
2026-03-29 18:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-29 18:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115
2026-03-29 18:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7611aa3f-9b4b-59d1-8b74-402dac8441ea with identifier: PX80115 to the API
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:45:43Z',
'fuel_type': 'petrol',
'id': '7611aa3f-9b4b-59d1-8b74-402dac8441ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX80115',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Splash',
'odometer': 33272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-06',
'seller_name': None,
'title': 'Suzuki Splash 1.2 Club',
'transmission': 'automatic',
'trim': 'Club',
'year': 2012}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Saving data for PX80115: {'auction_closing_time': 1774885543.0, 'created_time': 1774521690.849647, 'last_price_update_time': 1774809778.798912}
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX80115') HTTP/1.1" 204 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for FT78842: 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for YW76305: 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for XE32981: 0
2026-03-29 18:42:58 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-29 18:42:58 [auto1.de] INFO: Scrape type for RJ10234: 2
2026-03-29 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-29 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2ed279-1c7c-5855-be48-0f7a527b1e0d with scrape type 2
2026-03-29 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2ed279-1c7c-5855-be48-0f7a527b1e0d with scrape type 2
2026-03-29 18:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2ed279-1c7c-5855-be48-0f7a527b1e0d, identifier: RJ10234
2026-03-29 18:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-29 18:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-29 18:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234 to the API
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:06:10Z',
'fuel_type': 'petrol',
'id': 'dd2ed279-1c7c-5855-be48-0f7a527b1e0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ10234',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 21540,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-27',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2024}
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Saving data for RJ10234: {'auction_closing_time': 1774883170.0, 'created_time': 1773304642.434631, 'last_price_update_time': 1774809779.46132}
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ10234') HTTP/1.1" 204 0
2026-03-29 18:42:59 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-29 18:42:59 [auto1.de] INFO: Scrape type for GU49323: 0
2026-03-29 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:00 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:00 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Scrape type for PU73268: 2
2026-03-29 18:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-29 18:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07c0d91a-4bd2-5b0f-9144-89bf7972298f with scrape type 2
2026-03-29 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07c0d91a-4bd2-5b0f-9144-89bf7972298f with scrape type 2
2026-03-29 18:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07c0d91a-4bd2-5b0f-9144-89bf7972298f, identifier: PU73268
2026-03-29 18:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-29 18:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-29 18:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268 to the API
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:35:30Z',
'fuel_type': 'petrol',
'id': '07c0d91a-4bd2-5b0f-9144-89bf7972298f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU73268',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 122365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-13',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-29 18:43:00 [auto1.de] INFO: Saving data for PU73268: {'auction_closing_time': 1774884930.0, 'created_time': 1772541052.119915, 'last_price_update_time': 1774809780.914683}
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU73268') HTTP/1.1" 204 0
2026-03-29 18:43:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Scrape type for PR23937: 2
2026-03-29 18:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-29 18:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce06b55-bcd3-51ca-a2df-9964fa37f093 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cce06b55-bcd3-51ca-a2df-9964fa37f093 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cce06b55-bcd3-51ca-a2df-9964fa37f093, identifier: PR23937
2026-03-29 18:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-29 18:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-29 18:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937 to the API
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:41:25Z',
'fuel_type': 'diesel',
'id': 'cce06b55-bcd3-51ca-a2df-9964fa37f093',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR23937',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 199491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-14',
'seller_name': None,
'title': 'Peugeot 308 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2012}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Saving data for PR23937: {'auction_closing_time': 1774885285.0, 'created_time': 1774607872.255165, 'last_price_update_time': 1774809781.47727}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR23937') HTTP/1.1" 204 0
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Scrape type for VZ53815: 2
2026-03-29 18:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-29 18:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01108ae5-919a-5fcc-9c44-aba621086f73 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01108ae5-919a-5fcc-9c44-aba621086f73 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01108ae5-919a-5fcc-9c44-aba621086f73, identifier: VZ53815
2026-03-29 18:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-29 18:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815
2026-03-29 18:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01108ae5-919a-5fcc-9c44-aba621086f73 with identifier: VZ53815 to the API
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:01:27Z',
'fuel_type': 'petrol',
'id': '01108ae5-919a-5fcc-9c44-aba621086f73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ53815',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 189216,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1996-07-22',
'seller_name': None,
'title': 'Volkswagen Passat 1.8 Pacific',
'transmission': 'manual',
'trim': 'Pacific',
'year': 1996}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Saving data for VZ53815: {'auction_closing_time': 1774882887.0, 'created_time': 1774034603.878871, 'last_price_update_time': 1774809781.913956}
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ53815') HTTP/1.1" 204 0
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Scrape type for FC74080: 0
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Scrape type for HH54065: 0
2026-03-29 18:43:01 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-29 18:43:01 [auto1.de] INFO: Scrape type for VJ43142: 2
2026-03-29 18:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-29 18:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 406b3bbd-2e71-53bf-8730-52f7f46bba54 with scrape type 2
2026-03-29 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 406b3bbd-2e71-53bf-8730-52f7f46bba54 with scrape type 2
2026-03-29 18:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 406b3bbd-2e71-53bf-8730-52f7f46bba54, identifier: VJ43142
2026-03-29 18:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-29 18:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142
2026-03-29 18:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 406b3bbd-2e71-53bf-8730-52f7f46bba54 with identifier: VJ43142 to the API
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:41:56Z',
'fuel_type': 'petrol',
'id': '406b3bbd-2e71-53bf-8730-52f7f46bba54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ43142',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 8500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-21',
'seller_name': None,
'title': 'Seat Arona 1.0 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2023}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Saving data for VJ43142: {'auction_closing_time': 1774885316.0, 'created_time': 1774522649.588899, 'last_price_update_time': 1774809782.389289}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ43142') HTTP/1.1" 204 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for NZ91667: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for AY94594: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for GE56014: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for DW77915: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for AT78165: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for ZB00511: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for RS80830: 0
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-29 18:43:02 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12622%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Scrape type for LK12622: 2
2026-03-29 18:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-03-29 18:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38903159-416f-5f85-8a70-45e6cbe00e81 with scrape type 2
2026-03-29 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38903159-416f-5f85-8a70-45e6cbe00e81 with scrape type 2
2026-03-29 18:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38903159-416f-5f85-8a70-45e6cbe00e81, identifier: LK12622
2026-03-29 18:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-03-29 18:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622
2026-03-29 18:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38903159-416f-5f85-8a70-45e6cbe00e81 with identifier: LK12622 to the API
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:21:29Z',
'fuel_type': 'petrol',
'id': '38903159-416f-5f85-8a70-45e6cbe00e81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK12622',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 118433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-24',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2014}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12622%27 HTTP/1.1" 200 None
2026-03-29 18:43:02 [auto1.de] INFO: Saving data for LK12622: {'auction_closing_time': 1774884089.0, 'created_time': 1774118667.923489, 'last_price_update_time': 1774809782.939409}
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK12622') HTTP/1.1" 204 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Scrape type for ZR01639: 2
2026-03-29 18:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-29 18:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ca74376-76c1-5ed1-94ff-614a861ec9b5, identifier: ZR01639
2026-03-29 18:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-29 18:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-29 18:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639 to the API
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:09Z',
'fuel_type': 'petrol',
'id': '8ca74376-76c1-5ed1-94ff-614a861ec9b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR01639',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 56795,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-12',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT United',
'transmission': 'automatic',
'trim': 'United',
'year': 2021}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Saving data for ZR01639: {'auction_closing_time': 1774885809.0, 'created_time': 1773428974.29145, 'last_price_update_time': 1774809783.479759}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR01639') HTTP/1.1" 204 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Scrape type for VN50855: 2
2026-03-29 18:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-29 18:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ea6603-3a6d-5597-9c71-cef18cd9effd with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5ea6603-3a6d-5597-9c71-cef18cd9effd with scrape type 2
2026-03-29 18:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5ea6603-3a6d-5597-9c71-cef18cd9effd, identifier: VN50855
2026-03-29 18:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-29 18:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-29 18:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855 to the API
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:53:35Z',
'fuel_type': 'petrol',
'id': 'a5ea6603-3a6d-5597-9c71-cef18cd9effd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN50855',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 141178,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-24',
'seller_name': None,
'title': 'BMW 3er 320i GT xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2019}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-29 18:43:03 [auto1.de] INFO: Saving data for VN50855: {'auction_closing_time': 1774886015.0, 'created_time': 1773308186.079954, 'last_price_update_time': 1774809783.957005}
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN50855') HTTP/1.1" 204 0
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-29 18:43:03 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-29 18:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:04 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-29 18:43:04 [auto1.de] INFO: Scrape type for JU52980: 2
2026-03-29 18:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-29 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948, identifier: JU52980
2026-03-29 18:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-29 18:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-29 18:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980 to the API
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:26:18Z',
'fuel_type': 'diesel',
'id': '950bb0b9-ec6f-505c-9aa3-10fe8a8fa948',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU52980',
'listing': 'auction',
'make': 'Fiat',
'model': 'Fiorino',
'odometer': 24373,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-15',
'seller_name': None,
'title': 'Fiat Fiorino 1.3 M-Jet SX',
'transmission': 'manual',
'trim': 'SX',
'year': 2022}
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-29 18:43:04 [auto1.de] INFO: Saving data for JU52980: {'auction_closing_time': 1774884378.0, 'created_time': 1773303993.65365, 'last_price_update_time': 1774809784.577016}
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU52980') HTTP/1.1" 204 0
2026-03-29 18:43:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-29 18:43:04 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-29 18:43:04 [auto1.de] INFO: Scrape type for CM78973: 2
2026-03-29 18:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-29 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71af1f0-6c73-54a3-a5d1-652370f79286 with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71af1f0-6c73-54a3-a5d1-652370f79286 with scrape type 2
2026-03-29 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c71af1f0-6c73-54a3-a5d1-652370f79286, identifier: CM78973
2026-03-29 18:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-29 18:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973
2026-03-29 18:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c71af1f0-6c73-54a3-a5d1-652370f79286 with identifier: CM78973 to the API
2026-03-29 18:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:40:18Z',
'fuel_type': 'diesel',
'id': 'c71af1f0-6c73-54a3-a5d1-652370f79286',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM78973',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 212016,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-28',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Saving data for CM78973: {'auction_closing_time': 1774885218.0, 'created_time': 1773429234.930424, 'last_price_update_time': 1774809785.141034}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM78973') HTTP/1.1" 204 0
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Scrape type for EX22671: 2
2026-03-29 18:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-29 18:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4cdf85-78e5-5e8b-acc4-acb367780537 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4cdf85-78e5-5e8b-acc4-acb367780537 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b4cdf85-78e5-5e8b-acc4-acb367780537, identifier: EX22671
2026-03-29 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-29 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-29 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671 to the API
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:35:40Z',
'fuel_type': 'petrol',
'id': '3b4cdf85-78e5-5e8b-acc4-acb367780537',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX22671',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 135909,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-16',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2017}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Saving data for EX22671: {'auction_closing_time': 1774884940.0, 'created_time': 1774608028.557649, 'last_price_update_time': 1774809785.568539}
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX22671') HTTP/1.1" 204 0
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Scrape type for PP25437: 0
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Scrape type for TT40648: 0
2026-03-29 18:43:05 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-29 18:43:05 [auto1.de] INFO: Scrape type for HV45616: 2
2026-03-29 18:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-29 18:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2540f8-6be7-52b5-8977-7c8213769550 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db2540f8-6be7-52b5-8977-7c8213769550 with scrape type 2
2026-03-29 18:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2540f8-6be7-52b5-8977-7c8213769550, identifier: HV45616
2026-03-29 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-29 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-29 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616 to the API
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:16:17Z',
'fuel_type': 'petrol',
'id': 'db2540f8-6be7-52b5-8977-7c8213769550',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV45616',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 220217,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-05-10',
'seller_name': None,
'title': 'Opel Astra 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2005}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Saving data for HV45616: {'auction_closing_time': 1774883777.0, 'created_time': 1774608303.153247, 'last_price_update_time': 1774809786.099934}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV45616') HTTP/1.1" 204 0
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Scrape type for XE19125: 2
2026-03-29 18:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-29 18:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b186d73a-d055-5875-a0cd-f9c620e51bbc with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b186d73a-d055-5875-a0cd-f9c620e51bbc with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b186d73a-d055-5875-a0cd-f9c620e51bbc, identifier: XE19125
2026-03-29 18:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-29 18:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-29 18:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125 to the API
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:11:02Z',
'fuel_type': 'diesel',
'id': 'b186d73a-d055-5875-a0cd-f9c620e51bbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE19125',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 168849,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-28',
'seller_name': None,
'title': 'Skoda Yeti 2.0 TDI Active Plus Edition',
'transmission': 'manual',
'trim': 'Active Plus Edition',
'year': 2013}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Saving data for XE19125: {'auction_closing_time': 1774883462.0, 'created_time': 1774293395.749275, 'last_price_update_time': 1774809786.556211}
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE19125') HTTP/1.1" 204 0
2026-03-29 18:43:06 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-29 18:43:06 [auto1.de] INFO: Scrape type for TJ20795: 2
2026-03-29 18:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-29 18:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85741e5a-37a3-560e-b20b-461fec280f9a with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85741e5a-37a3-560e-b20b-461fec280f9a with scrape type 2
2026-03-29 18:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85741e5a-37a3-560e-b20b-461fec280f9a, identifier: TJ20795
2026-03-29 18:43:06 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 12 pages/min), scraped 775 items (at 112 items/min)
2026-03-29 18:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-29 18:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795
2026-03-29 18:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85741e5a-37a3-560e-b20b-461fec280f9a with identifier: TJ20795 to the API
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:18:20Z',
'fuel_type': 'petrol',
'id': '85741e5a-37a3-560e-b20b-461fec280f9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ20795',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 193370,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-19',
'seller_name': None,
'title': 'Opel Astra 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Saving data for TJ20795: {'auction_closing_time': 1774883900.0, 'created_time': 1774522498.830778, 'last_price_update_time': 1774809787.033308}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ20795') HTTP/1.1" 204 0
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Scrape type for GN10929: 2
2026-03-29 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-29 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2131cd56-c29c-5882-8015-c739915f157d with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2131cd56-c29c-5882-8015-c739915f157d with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2131cd56-c29c-5882-8015-c739915f157d, identifier: GN10929
2026-03-29 18:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-29 18:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-29 18:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929 to the API
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:04:55Z',
'fuel_type': 'diesel',
'id': '2131cd56-c29c-5882-8015-c739915f157d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN10929',
'listing': 'auction',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 207316,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-22',
'seller_name': None,
'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2019}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Saving data for GN10929: {'auction_closing_time': 1774883095.0, 'created_time': 1773775069.022754, 'last_price_update_time': 1774809787.469986}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN10929') HTTP/1.1" 204 0
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Scrape type for YE66083: 2
2026-03-29 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-29 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87da8ecd-f582-5461-a39b-0520f7579417 with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87da8ecd-f582-5461-a39b-0520f7579417 with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87da8ecd-f582-5461-a39b-0520f7579417, identifier: YE66083
2026-03-29 18:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-29 18:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-29 18:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083 to the API
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:40:55Z',
'fuel_type': 'hybrid',
'id': '87da8ecd-f582-5461-a39b-0520f7579417',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE66083',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 45331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2023}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Saving data for YE66083: {'auction_closing_time': 1774885255.0, 'created_time': 1773775921.971273, 'last_price_update_time': 1774809787.924763}
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE66083') HTTP/1.1" 204 0
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-29 18:43:07 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-29 18:43:07 [auto1.de] INFO: Scrape type for AK08323: 2
2026-03-29 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-29 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c276a8-99d1-5247-aa38-db4ac122d928 with scrape type 2
2026-03-29 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c276a8-99d1-5247-aa38-db4ac122d928 with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c276a8-99d1-5247-aa38-db4ac122d928, identifier: AK08323
2026-03-29 18:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-29 18:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-29 18:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323 to the API
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:37:59Z',
'fuel_type': 'petrol',
'id': '45c276a8-99d1-5247-aa38-db4ac122d928',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK08323',
'listing': 'auction',
'make': 'Jaguar',
'model': 'E-Pace',
'odometer': 76182,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-12',
'seller_name': None,
'title': 'Jaguar E-Pace P250 R-Dynamic HSE AWD',
'transmission': 'automatic',
'trim': 'R-Dynamic HSE AWD',
'year': 2018}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Saving data for AK08323: {'auction_closing_time': 1774885079.0, 'created_time': 1773984975.644639, 'last_price_update_time': 1774809788.37951}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK08323') HTTP/1.1" 204 0
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW69862%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Scrape type for GW69862: 2
2026-03-29 18:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862
2026-03-29 18:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d768c9b-67bd-5f58-acc2-e14e5ae740df with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d768c9b-67bd-5f58-acc2-e14e5ae740df with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d768c9b-67bd-5f58-acc2-e14e5ae740df, identifier: GW69862
2026-03-29 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862
2026-03-29 18:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862
2026-03-29 18:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d768c9b-67bd-5f58-acc2-e14e5ae740df with identifier: GW69862 to the API
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:15:53Z',
'fuel_type': 'petrol',
'id': '6d768c9b-67bd-5f58-acc2-e14e5ae740df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW69862',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 184111,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-22',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW69862%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Saving data for GW69862: {'auction_closing_time': 1774883753.0, 'created_time': 1774034315.890104, 'last_price_update_time': 1774809788.805542}
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW69862') HTTP/1.1" 204 0
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-29 18:43:08 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-29 18:43:08 [auto1.de] INFO: Scrape type for AW78451: 2
2026-03-29 18:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-29 18:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77a6e79-b54a-5afc-ab84-67ab178c8d85 with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c77a6e79-b54a-5afc-ab84-67ab178c8d85 with scrape type 2
2026-03-29 18:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c77a6e79-b54a-5afc-ab84-67ab178c8d85, identifier: AW78451
2026-03-29 18:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-29 18:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-29 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451 to the API
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:53:50Z',
'fuel_type': 'diesel',
'id': 'c77a6e79-b54a-5afc-ab84-67ab178c8d85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW78451',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 181887,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-08',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2016}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Saving data for AW78451: {'auction_closing_time': 1774886030.0, 'created_time': 1773917427.303254, 'last_price_update_time': 1774809789.241801}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW78451') HTTP/1.1" 204 0
2026-03-29 18:43:09 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-29 18:43:09 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Scrape type for NE74286: 2
2026-03-29 18:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-29 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fffbbe34-7db5-56c9-b937-9b4385b4acdd with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fffbbe34-7db5-56c9-b937-9b4385b4acdd with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fffbbe34-7db5-56c9-b937-9b4385b4acdd, identifier: NE74286
2026-03-29 18:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-29 18:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286
2026-03-29 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fffbbe34-7db5-56c9-b937-9b4385b4acdd with identifier: NE74286 to the API
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:20:56Z',
'fuel_type': 'petrol',
'id': 'fffbbe34-7db5-56c9-b937-9b4385b4acdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE74286',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 17610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-19',
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2022}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Saving data for NE74286: {'auction_closing_time': 1774884056.0, 'created_time': 1774522089.061562, 'last_price_update_time': 1774809789.74791}
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE74286') HTTP/1.1" 204 0
2026-03-29 18:43:09 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:09 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-29 18:43:09 [auto1.de] INFO: Scrape type for AK47916: 2
2026-03-29 18:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-29 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item febbbca0-2805-5891-b32d-eb10306c292e with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item febbbca0-2805-5891-b32d-eb10306c292e with scrape type 2
2026-03-29 18:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: febbbca0-2805-5891-b32d-eb10306c292e, identifier: AK47916
2026-03-29 18:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-29 18:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-29 18:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916 to the API
2026-03-29 18:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:08:41Z',
'fuel_type': 'diesel',
'id': 'febbbca0-2805-5891-b32d-eb10306c292e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK47916',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 300529,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-16',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2008}
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Saving data for AK47916: {'auction_closing_time': 1774883321.0, 'created_time': 1773306517.625499, 'last_price_update_time': 1774809790.245651}
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK47916') HTTP/1.1" 204 0
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Scrape type for RZ33260: 0
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Scrape type for FX17488: 2
2026-03-29 18:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-29 18:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce, identifier: FX17488
2026-03-29 18:43:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:10 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Scrape type for JW24568: 2
2026-03-29 18:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-29 18:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51564e3-9f42-597c-815a-088caf230849 with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c51564e3-9f42-597c-815a-088caf230849 with scrape type 2
2026-03-29 18:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c51564e3-9f42-597c-815a-088caf230849, identifier: JW24568
2026-03-29 18:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-29 18:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-29 18:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488 to the API
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 400,
'expiration_date': '2026-03-30T15:47:57Z',
'fuel_type': 'petrol',
'id': '84cd7975-bae1-561f-9649-3a0e1ba3e1ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX17488',
'listing': 'auction',
'make': 'Audi',
'model': 'RS Q3 Sportback',
'odometer': 92066,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-21',
'seller_name': None,
'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2020}
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-29 18:43:10 [auto1.de] INFO: Saving data for FX17488: {'auction_closing_time': 1774885677.0, 'created_time': 1773917376.402283, 'last_price_update_time': 1774809790.857388}
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX17488') HTTP/1.1" 204 0
2026-03-29 18:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-29 18:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-29 18:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568 to the API
2026-03-29 18:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:11:43Z',
'fuel_type': 'petrol',
'id': 'c51564e3-9f42-597c-815a-088caf230849',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW24568',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 111058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-18',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Saving data for JW24568: {'auction_closing_time': 1774883503.0, 'created_time': 1774608605.819046, 'last_price_update_time': 1774809791.195582}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW24568') HTTP/1.1" 204 0
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Scrape type for DW05211: 2
2026-03-29 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-29 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4775d05d-cad3-522a-8687-67eaae32a76c with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4775d05d-cad3-522a-8687-67eaae32a76c with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4775d05d-cad3-522a-8687-67eaae32a76c, identifier: DW05211
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-29 18:43:11 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Scrape type for ZR21062: 2
2026-03-29 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-29 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e540df-e4e6-5de2-9ee0-8d97839ac699 with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90e540df-e4e6-5de2-9ee0-8d97839ac699 with scrape type 2
2026-03-29 18:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90e540df-e4e6-5de2-9ee0-8d97839ac699, identifier: ZR21062
2026-03-29 18:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-29 18:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211
2026-03-29 18:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4775d05d-cad3-522a-8687-67eaae32a76c with identifier: DW05211 to the API
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:55:12Z',
'fuel_type': 'diesel',
'id': '4775d05d-cad3-522a-8687-67eaae32a76c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW05211',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 238483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-18',
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi BOSE-Edition',
'transmission': 'automatic',
'trim': 'BOSE-Edition',
'year': 2020}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-29 18:43:11 [auto1.de] INFO: Saving data for DW05211: {'auction_closing_time': 1774886112.0, 'created_time': 1774521710.379405, 'last_price_update_time': 1774809791.704052}
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW05211') HTTP/1.1" 204 0
2026-03-29 18:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-29 18:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-29 18:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062 to the API
2026-03-29 18:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:28:54Z',
'fuel_type': 'diesel',
'id': '90e540df-e4e6-5de2-9ee0-8d97839ac699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR21062',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 243381,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-30',
'seller_name': None,
'title': 'BMW 3er 320d EfficientDynamics Edition',
'transmission': 'manual',
'trim': 'EfficientDynamics Edition',
'year': 2011}
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Saving data for ZR21062: {'auction_closing_time': 1774884534.0, 'created_time': 1774291963.81644, 'last_price_update_time': 1774809792.151785}
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR21062') HTTP/1.1" 204 0
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for AA98436: 2
2026-03-29 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436
2026-03-29 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6cdecf1-c74d-56ff-8947-d46ccb87b34d with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6cdecf1-c74d-56ff-8947-d46ccb87b34d with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6cdecf1-c74d-56ff-8947-d46ccb87b34d, identifier: AA98436
2026-03-29 18:43:12 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Scrape type for ZC43990: 2
2026-03-29 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-29 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a322c4-87d2-50a9-aa69-6b9ffd087780 with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6a322c4-87d2-50a9-aa69-6b9ffd087780 with scrape type 2
2026-03-29 18:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6a322c4-87d2-50a9-aa69-6b9ffd087780, identifier: ZC43990
2026-03-29 18:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436
2026-03-29 18:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436
2026-03-29 18:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436 to the API
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:32:13Z',
'fuel_type': 'petrol',
'id': 'c6cdecf1-c74d-56ff-8947-d46ccb87b34d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA98436',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 52995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-31',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 TGDI GT",
'transmission': 'automatic',
'trim': 'GT',
'year': 2022}
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-29 18:43:12 [auto1.de] INFO: Saving data for AA98436: {'auction_closing_time': 1774884733.0, 'created_time': 1773344640.681668, 'last_price_update_time': 1774809792.79461}
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA98436') HTTP/1.1" 204 0
2026-03-29 18:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-29 18:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990
2026-03-29 18:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6a322c4-87d2-50a9-aa69-6b9ffd087780 with identifier: ZC43990 to the API
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:08Z',
'fuel_type': 'diesel',
'id': 'f6a322c4-87d2-50a9-aa69-6b9ffd087780',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC43990',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 75089,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-07',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi EcoBlue Mild-Hybrid ST-Line X',
'transmission': 'manual',
'trim': 'ST-Line X',
'year': 2021}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Saving data for ZC43990: {'auction_closing_time': 1774883228.0, 'created_time': 1774118992.997021, 'last_price_update_time': 1774809793.086519}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC43990') HTTP/1.1" 204 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for AM41961: 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for PU94869: 2
2026-03-29 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869
2026-03-29 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1eeb515-13b6-55ee-b704-c114df9ff25d with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1eeb515-13b6-55ee-b704-c114df9ff25d with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1eeb515-13b6-55ee-b704-c114df9ff25d, identifier: PU94869
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Scrape type for RB25738: 2
2026-03-29 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-29 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with scrape type 2
2026-03-29 18:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45, identifier: RB25738
2026-03-29 18:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869
2026-03-29 18:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869
2026-03-29 18:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1eeb515-13b6-55ee-b704-c114df9ff25d with identifier: PU94869 to the API
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:15:02Z',
'fuel_type': 'petrol',
'id': 'c1eeb515-13b6-55ee-b704-c114df9ff25d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU94869',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 100414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-09',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Saving data for PU94869: {'auction_closing_time': 1774883702.0, 'created_time': 1774636625.29264, 'last_price_update_time': 1774809793.627719}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU94869') HTTP/1.1" 204 0
2026-03-29 18:43:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-29 18:43:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-29 18:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738 to the API
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:29:00Z',
'fuel_type': 'diesel',
'id': '0c1a2099-0c16-53e5-aca6-4a76cc3efb45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB25738',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 196698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-06',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi ST',
'transmission': 'manual',
'trim': 'ST',
'year': 2017}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-29 18:43:13 [auto1.de] INFO: Saving data for RB25738: {'auction_closing_time': 1774884540.0, 'created_time': 1773775461.967046, 'last_price_update_time': 1774809793.966807}
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB25738') HTTP/1.1" 204 0
2026-03-29 18:43:13 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-29 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for WG01413: 2
2026-03-29 18:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-29 18:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96608814-f411-529b-a1a4-098b0d966baf with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96608814-f411-529b-a1a4-098b0d966baf with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96608814-f411-529b-a1a4-098b0d966baf, identifier: WG01413
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for WV70498: 0
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for ZH23061: 2
2026-03-29 18:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-29 18:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3806d3-11d9-55f2-a90b-90c31941c829 with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f3806d3-11d9-55f2-a90b-90c31941c829 with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f3806d3-11d9-55f2-a90b-90c31941c829, identifier: ZH23061
2026-03-29 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-29 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-29 18:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413 to the API
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:07:22Z',
'fuel_type': 'petrol',
'id': '96608814-f411-529b-a1a4-098b0d966baf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG01413',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 64125,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-12',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2017}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Saving data for WG01413: {'auction_closing_time': 1774883242.0, 'created_time': 1774034538.020237, 'last_price_update_time': 1774809794.574777}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG01413') HTTP/1.1" 204 0
2026-03-29 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-29 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-29 18:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061 to the API
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:15:54Z',
'fuel_type': 'petrol',
'id': '4f3806d3-11d9-55f2-a90b-90c31941c829',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH23061',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 96501,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-27',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2018}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Saving data for ZH23061: {'auction_closing_time': 1774883754.0, 'created_time': 1773861498.344512, 'last_price_update_time': 1774809794.903794}
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH23061') HTTP/1.1" 204 0
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for TW05581: 0
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for RS45157: 0
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-29 18:43:14 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-29 18:43:14 [auto1.de] INFO: Scrape type for UP84428: 2
2026-03-29 18:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-29 18:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7887e963-f9ff-5927-94de-77b242b6e6b1 with scrape type 2
2026-03-29 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7887e963-f9ff-5927-94de-77b242b6e6b1 with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7887e963-f9ff-5927-94de-77b242b6e6b1, identifier: UP84428
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for KM72305: 0
2026-03-29 18:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-29 18:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-29 18:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428 to the API
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:29:40Z',
'fuel_type': 'diesel',
'id': '7887e963-f9ff-5927-94de-77b242b6e6b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP84428',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 196034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-17',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'manual',
'trim': 'GTD BlueMotion Tech',
'year': 2015}
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Saving data for UP84428: {'auction_closing_time': 1774884580.0, 'created_time': 1774002241.427034, 'last_price_update_time': 1774809795.418788}
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP84428') HTTP/1.1" 204 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for VL43028: 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for YY60165: 0
2026-03-29 18:43:15 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-29 18:43:15 [auto1.de] INFO: Scrape type for XU86679: 2
2026-03-29 18:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-29 18:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc48c99e-4337-579d-8523-cf9e36237100 with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc48c99e-4337-579d-8523-cf9e36237100 with scrape type 2
2026-03-29 18:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc48c99e-4337-579d-8523-cf9e36237100, identifier: XU86679
2026-03-29 18:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-29 18:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-29 18:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679 to the API
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:10:11Z',
'fuel_type': 'petrol',
'id': 'cc48c99e-4337-579d-8523-cf9e36237100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU86679',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 52202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-26',
'seller_name': None,
'title': 'Seat Arona 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2022}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Saving data for XU86679: {'auction_closing_time': 1774883411.0, 'created_time': 1773344426.681026, 'last_price_update_time': 1774809796.034741}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU86679') HTTP/1.1" 204 0
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Scrape type for VJ29661: 2
2026-03-29 18:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-29 18:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36dccb9f-bede-593e-a7e5-6d4749ac3052 with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36dccb9f-bede-593e-a7e5-6d4749ac3052 with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36dccb9f-bede-593e-a7e5-6d4749ac3052, identifier: VJ29661
2026-03-29 18:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-29 18:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-29 18:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661 to the API
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:36:29Z',
'fuel_type': 'petrol',
'id': '36dccb9f-bede-593e-a7e5-6d4749ac3052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ29661',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 54306,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-15',
'seller_name': None,
'title': 'Citroen C4 1.6 VTi VTR Plus',
'transmission': 'automatic',
'trim': 'VTR Plus',
'year': 2009}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Saving data for VJ29661: {'auction_closing_time': 1774884989.0, 'created_time': 1774608574.469571, 'last_price_update_time': 1774809796.539873}
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ29661') HTTP/1.1" 204 0
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Scrape type for EL67777: 0
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Scrape type for HL95475: 0
2026-03-29 18:43:16 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-29 18:43:16 [auto1.de] INFO: Scrape type for UX48590: 2
2026-03-29 18:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-29 18:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8a9319-d6d8-5622-bed5-4f22327961fe with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da8a9319-d6d8-5622-bed5-4f22327961fe with scrape type 2
2026-03-29 18:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da8a9319-d6d8-5622-bed5-4f22327961fe, identifier: UX48590
2026-03-29 18:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-29 18:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-29 18:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590 to the API
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:32:04Z',
'fuel_type': 'petrol',
'id': 'da8a9319-d6d8-5622-bed5-4f22327961fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX48590',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 141876,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-09',
'seller_name': None,
'title': 'Renault Clio 0.9 Energy Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2015}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Saving data for UX48590: {'auction_closing_time': 1774884724.0, 'created_time': 1773859300.489328, 'last_price_update_time': 1774809797.013172}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX48590') HTTP/1.1" 204 0
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Scrape type for LN92590: 2
2026-03-29 18:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-29 18:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with scrape type 2
2026-03-29 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with scrape type 2
2026-03-29 18:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9, identifier: LN92590
2026-03-29 18:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-29 18:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590
2026-03-29 18:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b90e1bb0-d68d-51ed-81fd-a660fe52cdf9 with identifier: LN92590 to the API
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:48:44Z',
'fuel_type': 'diesel',
'id': 'b90e1bb0-d68d-51ed-81fd-a660fe52cdf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN92590',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 259899,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-01',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Individual',
'transmission': 'automatic',
'trim': 'Individual',
'year': 2016}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Saving data for LN92590: {'auction_closing_time': 1774885724.0, 'created_time': 1774522519.204727, 'last_price_update_time': 1774809797.547228}
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN92590') HTTP/1.1" 204 0
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Scrape type for RB75427: 0
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Scrape type for HJ09616: 0
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-29 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:17 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Scrape type for UR24224: 0
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-29 18:43:17 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-29 18:43:17 [auto1.de] INFO: Scrape type for SG45396: 2
2026-03-29 18:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-29 18:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b14690-fdc5-55ad-a2e2-b11dc317f145 with scrape type 2
2026-03-29 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b14690-fdc5-55ad-a2e2-b11dc317f145 with scrape type 2
2026-03-29 18:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b14690-fdc5-55ad-a2e2-b11dc317f145, identifier: SG45396
2026-03-29 18:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-29 18:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-29 18:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396 to the API
2026-03-29 18:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:29Z',
'fuel_type': 'petrol',
'id': '65b14690-fdc5-55ad-a2e2-b11dc317f145',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG45396',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 157871,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-29',
'seller_name': None,
'title': 'Mazda 5 1.8 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2008}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Saving data for SG45396: {'auction_closing_time': 1774883489.0, 'created_time': 1774608579.644029, 'last_price_update_time': 1774809798.196722}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG45396') HTTP/1.1" 204 0
2026-03-29 18:43:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for SV23538: 0
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for XH15947: 0
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for LK47364: 2
2026-03-29 18:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364
2026-03-29 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa54504c-538f-5e19-aeb0-9935aa3a8c49 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa54504c-538f-5e19-aeb0-9935aa3a8c49 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa54504c-538f-5e19-aeb0-9935aa3a8c49, identifier: LK47364
2026-03-29 18:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364
2026-03-29 18:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364
2026-03-29 18:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa54504c-538f-5e19-aeb0-9935aa3a8c49 with identifier: LK47364 to the API
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:06:18Z',
'fuel_type': 'diesel',
'id': 'fa54504c-538f-5e19-aeb0-9935aa3a8c49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK47364',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 106353,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-28',
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2019}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Saving data for LK47364: {'auction_closing_time': 1774883178.0, 'created_time': 1774550180.456238, 'last_price_update_time': 1774809798.735268}
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK47364') HTTP/1.1" 204 0
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for DE54360: 0
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for HA43424: 0
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-29 18:43:18 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-29 18:43:18 [auto1.de] INFO: Scrape type for CE85756: 2
2026-03-29 18:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-29 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with scrape type 2
2026-03-29 18:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0, identifier: CE85756
2026-03-29 18:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-29 18:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-29 18:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756 to the API
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:39:28Z',
'fuel_type': 'petrol',
'id': 'b7a9fb5c-4305-5cbe-a28b-6748434ca9a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE85756',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 28024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-23',
'seller_name': None,
'title': 'Hyundai i20 1.2 Go',
'transmission': 'manual',
'trim': 'Go',
'year': 2017}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Saving data for CE85756: {'auction_closing_time': 1774885168.0, 'created_time': 1774608016.406347, 'last_price_update_time': 1774809799.303719}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE85756') HTTP/1.1" 204 0
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Scrape type for ZC46474: 2
2026-03-29 18:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-29 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47fe68f0-819e-5086-ae22-e304773452dc with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47fe68f0-819e-5086-ae22-e304773452dc with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47fe68f0-819e-5086-ae22-e304773452dc, identifier: ZC46474
2026-03-29 18:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-29 18:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474
2026-03-29 18:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47fe68f0-819e-5086-ae22-e304773452dc with identifier: ZC46474 to the API
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:33:46Z',
'fuel_type': 'petrol',
'id': '47fe68f0-819e-5086-ae22-e304773452dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC46474',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 201684,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-27',
'seller_name': None,
'title': 'Ford Mondeo 2.0 Futura X',
'transmission': 'manual',
'trim': 'Futura X',
'year': 2006}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Saving data for ZC46474: {'auction_closing_time': 1774884826.0, 'created_time': 1774034542.096155, 'last_price_update_time': 1774809799.721373}
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC46474') HTTP/1.1" 204 0
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Scrape type for AK86210: 0
2026-03-29 18:43:19 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-29 18:43:19 [auto1.de] INFO: Scrape type for TP63810: 2
2026-03-29 18:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-29 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 080787a8-56cb-5197-8195-0b0097879d7e with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 080787a8-56cb-5197-8195-0b0097879d7e with scrape type 2
2026-03-29 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 080787a8-56cb-5197-8195-0b0097879d7e, identifier: TP63810
2026-03-29 18:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-29 18:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-29 18:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810 to the API
2026-03-29 18:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:55Z',
'fuel_type': 'petrol',
'id': '080787a8-56cb-5197-8195-0b0097879d7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP63810',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 68201,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-01',
'seller_name': None,
'title': 'Audi Q2 35 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2022}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Saving data for TP63810: {'auction_closing_time': 1774885675.0, 'created_time': 1774293682.994105, 'last_price_update_time': 1774809800.205837}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP63810') HTTP/1.1" 204 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for XJ24379: 2
2026-03-29 18:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379
2026-03-29 18:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb817ec-6b32-507f-8a33-f88269222622 with scrape type 2
2026-03-29 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb817ec-6b32-507f-8a33-f88269222622 with scrape type 2
2026-03-29 18:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acb817ec-6b32-507f-8a33-f88269222622, identifier: XJ24379
2026-03-29 18:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379
2026-03-29 18:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379
2026-03-29 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acb817ec-6b32-507f-8a33-f88269222622 with identifier: XJ24379 to the API
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:49:50Z',
'fuel_type': 'diesel',
'id': 'acb817ec-6b32-507f-8a33-f88269222622',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ24379',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 292533,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-16',
'seller_name': None,
'title': 'Ford C-Max 1.6 TDCi Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Saving data for XJ24379: {'auction_closing_time': 1774885790.0, 'created_time': 1774636623.984213, 'last_price_update_time': 1774809800.706291}
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ24379') HTTP/1.1" 204 0
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-29 18:43:20 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-29 18:43:20 [auto1.de] INFO: Scrape type for WZ35506: 2
2026-03-29 18:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-29 18:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with scrape type 2
2026-03-29 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with scrape type 2
2026-03-29 18:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2, identifier: WZ35506
2026-03-29 18:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-29 18:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-29 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506 to the API
2026-03-29 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:13:24Z',
'fuel_type': 'diesel',
'id': 'b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ35506',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 199490,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-08',
'seller_name': None,
'title': 'BMW 1er 120d xDrive Sport Line',
'transmission': 'automatic',
'trim': 'xDrive Sport Line',
'year': 2016}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Saving data for WZ35506: {'auction_closing_time': 1774883604.0, 'created_time': 1773303641.468646, 'last_price_update_time': 1774809801.18099}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ35506') HTTP/1.1" 204 0
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Scrape type for CV81199: 2
2026-03-29 18:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-29 18:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6086a7-abd0-529e-8d19-e032a96ef630 with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6086a7-abd0-529e-8d19-e032a96ef630 with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d6086a7-abd0-529e-8d19-e032a96ef630, identifier: CV81199
2026-03-29 18:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-29 18:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-29 18:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199 to the API
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:16:37Z',
'fuel_type': 'petrol',
'id': '0d6086a7-abd0-529e-8d19-e032a96ef630',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV81199',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-5',
'odometer': 79840,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-18',
'seller_name': None,
'title': 'Mazda CX-5 2.0 Sendo 2WD',
'transmission': 'manual',
'trim': 'Sendo 2WD',
'year': 2014}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Saving data for CV81199: {'auction_closing_time': 1774883797.0, 'created_time': 1773775629.093129, 'last_price_update_time': 1774809801.735224}
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV81199') HTTP/1.1" 204 0
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Scrape type for WN39495: 0
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Scrape type for JA72326: 0
2026-03-29 18:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:21 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:21 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-29 18:43:21 [auto1.de] INFO: Scrape type for XV42513: 2
2026-03-29 18:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-29 18:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9a485c-99e3-571b-a7fe-61c04238e6eb with scrape type 2
2026-03-29 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd9a485c-99e3-571b-a7fe-61c04238e6eb with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd9a485c-99e3-571b-a7fe-61c04238e6eb, identifier: XV42513
2026-03-29 18:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-29 18:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513
2026-03-29 18:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd9a485c-99e3-571b-a7fe-61c04238e6eb with identifier: XV42513 to the API
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:17:55Z',
'fuel_type': 'diesel',
'id': 'cd9a485c-99e3-571b-a7fe-61c04238e6eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV42513',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T4 Kombi',
'odometer': 405975,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-06-22',
'seller_name': None,
'title': 'Volkswagen T4 Kombi 2.5 TDI',
'transmission': 'manual',
'trim': '',
'year': 1998}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Saving data for XV42513: {'auction_closing_time': 1774883875.0, 'created_time': 1774521679.778747, 'last_price_update_time': 1774809802.369962}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV42513') HTTP/1.1" 204 0
2026-03-29 18:43:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Scrape type for CL87720: 2
2026-03-29 18:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-29 18:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee5596a6-f10b-506e-9f8a-8eaa2fee8398, identifier: CL87720
2026-03-29 18:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-29 18:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720
2026-03-29 18:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee5596a6-f10b-506e-9f8a-8eaa2fee8398 with identifier: CL87720 to the API
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 330,
'expiration_date': '2026-03-30T15:03:23Z',
'fuel_type': 'diesel',
'id': 'ee5596a6-f10b-506e-9f8a-8eaa2fee8398',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL87720',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 179760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-19',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2021}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Saving data for CL87720: {'auction_closing_time': 1774883003.0, 'created_time': 1774521893.25755, 'last_price_update_time': 1774809802.774029}
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL87720') HTTP/1.1" 204 0
2026-03-29 18:43:22 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-29 18:43:22 [auto1.de] INFO: Scrape type for GD49252: 2
2026-03-29 18:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-29 18:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02bd64a-f1be-5e24-b147-9347c9d11809 with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02bd64a-f1be-5e24-b147-9347c9d11809 with scrape type 2
2026-03-29 18:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02bd64a-f1be-5e24-b147-9347c9d11809, identifier: GD49252
2026-03-29 18:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-29 18:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-29 18:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252 to the API
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:09:08Z',
'fuel_type': 'petrol',
'id': 'f02bd64a-f1be-5e24-b147-9347c9d11809',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD49252',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 48483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seller_name': None,
'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2020}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Saving data for GD49252: {'auction_closing_time': 1774883348.0, 'created_time': 1773861488.63502, 'last_price_update_time': 1774809803.257679}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD49252') HTTP/1.1" 204 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for NV88353: 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for XF94363: 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for HC04240: 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for CK46360: 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for CS93004: 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for SD16829: 2
2026-03-29 18:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-29 18:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd95f98a-fd1a-5f17-b6a9-a915b666da37 with scrape type 2
2026-03-29 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd95f98a-fd1a-5f17-b6a9-a915b666da37 with scrape type 2
2026-03-29 18:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd95f98a-fd1a-5f17-b6a9-a915b666da37, identifier: SD16829
2026-03-29 18:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-29 18:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829
2026-03-29 18:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd95f98a-fd1a-5f17-b6a9-a915b666da37 with identifier: SD16829 to the API
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:13:08Z',
'fuel_type': 'diesel',
'id': 'cd95f98a-fd1a-5f17-b6a9-a915b666da37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD16829',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 231272,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-27',
'seller_name': None,
'title': 'Renault Megane 1.5 BLUE dCi Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2020}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Saving data for SD16829: {'auction_closing_time': 1774883588.0, 'created_time': 1773687047.979033, 'last_price_update_time': 1774809803.848232}
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD16829') HTTP/1.1" 204 0
2026-03-29 18:43:23 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-29 18:43:23 [auto1.de] INFO: Scrape type for KF41308: 2
2026-03-29 18:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-29 18:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957eb23d-41ee-505f-b33e-194f71c469a8 with scrape type 2
2026-03-29 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957eb23d-41ee-505f-b33e-194f71c469a8 with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957eb23d-41ee-505f-b33e-194f71c469a8, identifier: KF41308
2026-03-29 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-29 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-29 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308 to the API
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:06:00Z',
'fuel_type': 'diesel',
'id': '957eb23d-41ee-505f-b33e-194f71c469a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF41308',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 172823,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
'transmission': 'manual',
'trim': '310 L2 Tourneo Titanium',
'year': 2016}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Saving data for KF41308: {'auction_closing_time': 1774883160.0, 'created_time': 1774293587.34379, 'last_price_update_time': 1774809804.344492}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF41308') HTTP/1.1" 204 0
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for FD22353: 2
2026-03-29 18:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-29 18:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c535e8c-19b9-514e-b8dc-66192d92671e with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c535e8c-19b9-514e-b8dc-66192d92671e with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c535e8c-19b9-514e-b8dc-66192d92671e, identifier: FD22353
2026-03-29 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-29 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-29 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353 to the API
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:34:48Z',
'fuel_type': 'petrol',
'id': '2c535e8c-19b9-514e-b8dc-66192d92671e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD22353',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 92812,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2019}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Saving data for FD22353: {'auction_closing_time': 1774884888.0, 'created_time': 1774608681.637625, 'last_price_update_time': 1774809804.893773}
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD22353') HTTP/1.1" 204 0
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for VN30485: 0
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for LK64393: 0
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-29 18:43:24 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-29 18:43:24 [auto1.de] INFO: Scrape type for WE98596: 2
2026-03-29 18:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596
2026-03-29 18:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a461d4e9-6994-521f-9ad6-1bfe0e49da20 with scrape type 2
2026-03-29 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a461d4e9-6994-521f-9ad6-1bfe0e49da20 with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a461d4e9-6994-521f-9ad6-1bfe0e49da20, identifier: WE98596
2026-03-29 18:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596
2026-03-29 18:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596
2026-03-29 18:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a461d4e9-6994-521f-9ad6-1bfe0e49da20 with identifier: WE98596 to the API
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:47:50Z',
'fuel_type': 'petrol',
'id': 'a461d4e9-6994-521f-9ad6-1bfe0e49da20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE98596',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 163083,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-27',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Saving data for WE98596: {'auction_closing_time': 1774885670.0, 'created_time': 1774035232.832191, 'last_price_update_time': 1774809805.381298}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE98596') HTTP/1.1" 204 0
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Scrape type for AJ62547: 2
2026-03-29 18:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-29 18:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd962045-a104-51c0-a1b3-aa3c90ceebfe with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd962045-a104-51c0-a1b3-aa3c90ceebfe with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd962045-a104-51c0-a1b3-aa3c90ceebfe, identifier: AJ62547
2026-03-29 18:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-29 18:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547
2026-03-29 18:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd962045-a104-51c0-a1b3-aa3c90ceebfe with identifier: AJ62547 to the API
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:23:04Z',
'fuel_type': 'diesel',
'id': 'cd962045-a104-51c0-a1b3-aa3c90ceebfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ62547',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 212372,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'automatic',
'trim': 'GTD BlueMotion Tech',
'year': 2016}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Saving data for AJ62547: {'auction_closing_time': 1774884184.0, 'created_time': 1773387326.317656, 'last_price_update_time': 1774809805.782108}
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ62547') HTTP/1.1" 204 0
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-29 18:43:25 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-29 18:43:25 [auto1.de] INFO: Scrape type for AW80803: 2
2026-03-29 18:43:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-29 18:43:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with scrape type 2
2026-03-29 18:43:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037, identifier: AW80803
2026-03-29 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-29 18:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-29 18:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803 to the API
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T16:00:00Z',
'fuel_type': 'hybrid',
'id': 'b4023a4d-bbf6-5c67-8337-e0ce3cfc3037',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW80803',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 21405,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-04-15',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 250e Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2024}
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Saving data for AW80803: {'auction_closing_time': 1774886400.0, 'created_time': 1772728430.984605, 'last_price_update_time': 1774809806.347355}
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW80803') HTTP/1.1" 204 0
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Scrape type for BH52991: 2
2026-03-29 18:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-29 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c245e84d-4d51-5afd-a186-d7366278e0a2 with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c245e84d-4d51-5afd-a186-d7366278e0a2 with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c245e84d-4d51-5afd-a186-d7366278e0a2, identifier: BH52991
2026-03-29 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-29 18:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-29 18:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991 to the API
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:30:18Z',
'fuel_type': 'diesel',
'id': 'c245e84d-4d51-5afd-a186-d7366278e0a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH52991',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 217795,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-13',
'seller_name': None,
'title': 'Citroen C4 1.6 HDi Business Class',
'transmission': 'manual',
'trim': 'Business Class',
'year': 2013}
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Saving data for BH52991: {'auction_closing_time': 1774884618.0, 'created_time': 1773401314.713024, 'last_price_update_time': 1774809806.792315}
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH52991') HTTP/1.1" 204 0
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Scrape type for GU66110: 0
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Scrape type for AL23415: 0
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Scrape type for KY72629: 0
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-29 18:43:26 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-29 18:43:26 [auto1.de] INFO: Scrape type for ME89657: 2
2026-03-29 18:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-29 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with scrape type 2
2026-03-29 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a, identifier: ME89657
2026-03-29 18:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-29 18:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-29 18:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657 to the API
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:41:24Z',
'fuel_type': 'diesel',
'id': '4ca1e339-af0d-51ec-a9c0-bf60c09fb49a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME89657',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 84326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-08',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Control M',
'transmission': 'manual',
'trim': 'Control M',
'year': 2019}
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Saving data for ME89657: {'auction_closing_time': 1774885284.0, 'created_time': 1774608164.120512, 'last_price_update_time': 1774809807.304874}
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME89657') HTTP/1.1" 204 0
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Scrape type for GJ05712: 2
2026-03-29 18:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-29 18:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229e9702-9c5e-5161-a439-cf962bb05127 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229e9702-9c5e-5161-a439-cf962bb05127 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 229e9702-9c5e-5161-a439-cf962bb05127, identifier: GJ05712
2026-03-29 18:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-29 18:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-29 18:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712 to the API
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:47:44Z',
'fuel_type': 'petrol',
'id': '229e9702-9c5e-5161-a439-cf962bb05127',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ05712',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 199160,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-19',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2013}
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Saving data for GJ05712: {'auction_closing_time': 1774885664.0, 'created_time': 1773383453.145624, 'last_price_update_time': 1774809807.851706}
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ05712') HTTP/1.1" 204 0
2026-03-29 18:43:27 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-29 18:43:27 [auto1.de] INFO: Scrape type for TT27495: 2
2026-03-29 18:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495
2026-03-29 18:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da10f0f6-2187-5e77-b695-35c081abfd46 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da10f0f6-2187-5e77-b695-35c081abfd46 with scrape type 2
2026-03-29 18:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da10f0f6-2187-5e77-b695-35c081abfd46, identifier: TT27495
2026-03-29 18:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495
2026-03-29 18:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495
2026-03-29 18:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da10f0f6-2187-5e77-b695-35c081abfd46 with identifier: TT27495 to the API
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:02:24Z',
'fuel_type': 'petrol',
'id': 'da10f0f6-2187-5e77-b695-35c081abfd46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT27495',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 186762,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-26',
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2011}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Saving data for TT27495: {'auction_closing_time': 1774882944.0, 'created_time': 1773136860.511477, 'last_price_update_time': 1774809808.264506}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT27495') HTTP/1.1" 204 0
2026-03-29 18:43:28 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Scrape type for ZM99082: 0
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Scrape type for FJ59032: 0
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Scrape type for BD50097: 2
2026-03-29 18:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-29 18:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af297216-e1f5-5156-a455-3c8afaf1467b with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af297216-e1f5-5156-a455-3c8afaf1467b with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af297216-e1f5-5156-a455-3c8afaf1467b, identifier: BD50097
2026-03-29 18:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-29 18:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-29 18:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097 to the API
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:49:09Z',
'fuel_type': 'petrol',
'id': 'af297216-e1f5-5156-a455-3c8afaf1467b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD50097',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 57107,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-06',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Saving data for BD50097: {'auction_closing_time': 1774885749.0, 'created_time': 1774607938.354709, 'last_price_update_time': 1774809808.754261}
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD50097') HTTP/1.1" 204 0
2026-03-29 18:43:28 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-29 18:43:28 [auto1.de] INFO: Scrape type for LM85601: 2
2026-03-29 18:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-29 18:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d60d65-98ae-59b3-9e5b-c52df001aa14 with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7d60d65-98ae-59b3-9e5b-c52df001aa14 with scrape type 2
2026-03-29 18:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7d60d65-98ae-59b3-9e5b-c52df001aa14, identifier: LM85601
2026-03-29 18:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-29 18:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-29 18:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601 to the API
2026-03-29 18:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:52:44Z',
'fuel_type': 'petrol',
'id': 'b7d60d65-98ae-59b3-9e5b-c52df001aa14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM85601',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 214569,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-19',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
'transmission': 'manual',
'trim': 'Dream Team 2WD',
'year': 2013}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Saving data for LM85601: {'auction_closing_time': 1774885964.0, 'created_time': 1774607908.521715, 'last_price_update_time': 1774809809.231361}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM85601') HTTP/1.1" 204 0
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Scrape type for XU55815: 2
2026-03-29 18:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-29 18:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f446d91-50e7-5bc0-934f-0bf01935e8df with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f446d91-50e7-5bc0-934f-0bf01935e8df with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f446d91-50e7-5bc0-934f-0bf01935e8df, identifier: XU55815
2026-03-29 18:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-29 18:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-29 18:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815 to the API
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:52:01Z',
'fuel_type': 'diesel',
'id': '3f446d91-50e7-5bc0-934f-0bf01935e8df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU55815',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 198988,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Lounge Sport & Style 4Motion BlueMotion',
'year': 2015}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Saving data for XU55815: {'auction_closing_time': 1774885921.0, 'created_time': 1773861341.399962, 'last_price_update_time': 1774809809.828056}
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU55815') HTTP/1.1" 204 0
2026-03-29 18:43:29 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-29 18:43:29 [auto1.de] INFO: Scrape type for FG98454: 2
2026-03-29 18:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-29 18:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135badff-bd07-5ffe-bd4f-6037c314d211 with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 135badff-bd07-5ffe-bd4f-6037c314d211 with scrape type 2
2026-03-29 18:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 135badff-bd07-5ffe-bd4f-6037c314d211, identifier: FG98454
2026-03-29 18:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-29 18:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-29 18:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454 to the API
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:53:56Z',
'fuel_type': 'diesel',
'id': '135badff-bd07-5ffe-bd4f-6037c314d211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG98454',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 282080,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-24',
'seller_name': None,
'title': 'Volvo V70 2.4 D Kinetic',
'transmission': 'automatic',
'trim': 'Kinetic',
'year': 2009}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Saving data for FG98454: {'auction_closing_time': 1774886036.0, 'created_time': 1774263790.541595, 'last_price_update_time': 1774809810.295291}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG98454') HTTP/1.1" 204 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for CD03678: 2
2026-03-29 18:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678
2026-03-29 18:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with scrape type 2
2026-03-29 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with scrape type 2
2026-03-29 18:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bacc78c-8797-5a4e-b48c-daf4c8d89674, identifier: CD03678
2026-03-29 18:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678
2026-03-29 18:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678
2026-03-29 18:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bacc78c-8797-5a4e-b48c-daf4c8d89674 with identifier: CD03678 to the API
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:42:49Z',
'fuel_type': 'gas',
'id': '8bacc78c-8797-5a4e-b48c-daf4c8d89674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD03678',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 13382,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-07-23',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Essential',
'transmission': 'manual',
'trim': 'Essential',
'year': 2025}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Saving data for CD03678: {'auction_closing_time': 1774885369.0, 'created_time': 1774033506.75049, 'last_price_update_time': 1774809810.703586}
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD03678') HTTP/1.1" 204 0
2026-03-29 18:43:30 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-29 18:43:30 [auto1.de] INFO: Scrape type for YX31470: 2
2026-03-29 18:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-29 18:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16114773-44e1-55d2-8dc9-4677562bd431 with scrape type 2
2026-03-29 18:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16114773-44e1-55d2-8dc9-4677562bd431 with scrape type 2
2026-03-29 18:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16114773-44e1-55d2-8dc9-4677562bd431, identifier: YX31470
2026-03-29 18:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-29 18:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-29 18:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470 to the API
2026-03-29 18:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:05:47Z',
'fuel_type': 'diesel',
'id': '16114773-44e1-55d2-8dc9-4677562bd431',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX31470',
'listing': 'auction',
'make': 'BMW',
'model': 'X6',
'odometer': 196991,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-22',
'seller_name': None,
'title': 'BMW X6 xDrive 40d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Saving data for YX31470: {'auction_closing_time': 1774883147.0, 'created_time': 1773467112.562213, 'last_price_update_time': 1774809811.353102}
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX31470') HTTP/1.1" 204 0
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Scrape type for EC14916: 0
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Scrape type for FP02134: 0
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Scrape type for MK08111: 2
2026-03-29 18:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-29 18:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with scrape type 2
2026-03-29 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with scrape type 2
2026-03-29 18:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1, identifier: MK08111
2026-03-29 18:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-29 18:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-29 18:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111 to the API
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:12:50Z',
'fuel_type': 'petrol',
'id': 'ca2f32e2-e041-5ec7-970a-8bacd89d8bd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK08111',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 108171,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-22',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Saving data for MK08111: {'auction_closing_time': 1774883570.0, 'created_time': 1773831554.586064, 'last_price_update_time': 1774809811.868757}
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK08111') HTTP/1.1" 204 0
2026-03-29 18:43:31 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-29 18:43:31 [auto1.de] INFO: Scrape type for UE87725: 2
2026-03-29 18:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-29 18:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with scrape type 2
2026-03-29 18:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3, identifier: UE87725
2026-03-29 18:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-29 18:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-29 18:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725 to the API
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:53:54Z',
'fuel_type': 'diesel',
'id': '25ce90e7-3ccc-5aad-9400-42c2f91eb8a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE87725',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 138325,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-30',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2015}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Saving data for UE87725: {'auction_closing_time': 1774886034.0, 'created_time': 1774265145.58714, 'last_price_update_time': 1774809812.470206}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE87725') HTTP/1.1" 204 0
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for NC46979: 2
2026-03-29 18:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-29 18:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdd9516-2c72-501c-91fb-f10500fbcd1e with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bdd9516-2c72-501c-91fb-f10500fbcd1e with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bdd9516-2c72-501c-91fb-f10500fbcd1e, identifier: NC46979
2026-03-29 18:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-29 18:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-29 18:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979 to the API
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:55:18Z',
'fuel_type': 'diesel',
'id': '4bdd9516-2c72-501c-91fb-f10500fbcd1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC46979',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon Shooting Brake',
'odometer': 125285,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-13',
'seller_name': None,
'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Saving data for NC46979: {'auction_closing_time': 1774886118.0, 'created_time': 1773383627.538955, 'last_price_update_time': 1774809812.952627}
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC46979') HTTP/1.1" 204 0
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-29 18:43:32 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-29 18:43:32 [auto1.de] INFO: Scrape type for XC92552: 2
2026-03-29 18:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-29 18:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033e6181-c47b-5fc7-a64e-6e4a05601912 with scrape type 2
2026-03-29 18:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033e6181-c47b-5fc7-a64e-6e4a05601912 with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 033e6181-c47b-5fc7-a64e-6e4a05601912, identifier: XC92552
2026-03-29 18:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-29 18:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-29 18:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552 to the API
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:37:34Z',
'fuel_type': 'petrol',
'id': '033e6181-c47b-5fc7-a64e-6e4a05601912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC92552',
'listing': 'auction',
'make': 'Subaru',
'model': 'XV',
'odometer': 246270,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-02',
'seller_name': None,
'title': 'Subaru XV 2.0 Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2018}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Saving data for XC92552: {'auction_closing_time': 1774885054.0, 'created_time': 1773383044.674937, 'last_price_update_time': 1774809813.38936}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC92552') HTTP/1.1" 204 0
2026-03-29 18:43:33 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for UC42370: 2
2026-03-29 18:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-29 18:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e33a2d-6e43-5099-902d-7c9ab13bc33a, identifier: UC42370
2026-03-29 18:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-29 18:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-29 18:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370 to the API
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:41:42Z',
'fuel_type': 'petrol',
'id': '02e33a2d-6e43-5099-902d-7c9ab13bc33a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC42370',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Picasso',
'odometer': 66257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-10',
'seller_name': None,
'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2011}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Saving data for UC42370: {'auction_closing_time': 1774885302.0, 'created_time': 1774608066.222625, 'last_price_update_time': 1774809813.846103}
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC42370') HTTP/1.1" 204 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for WC33817: 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for PB35717: 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for MP89368: 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for PV26171: 0
2026-03-29 18:43:33 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-29 18:43:33 [auto1.de] INFO: Scrape type for FX08537: 2
2026-03-29 18:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-29 18:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with scrape type 2
2026-03-29 18:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with scrape type 2
2026-03-29 18:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2, identifier: FX08537
2026-03-29 18:43:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Scrape type for LN34178: 0
2026-03-29 18:43:34 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Scrape type for WV16405: 2
2026-03-29 18:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-29 18:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ea9934-f283-5868-8c91-7b56cdd1fd6a with scrape type 2
2026-03-29 18:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ea9934-f283-5868-8c91-7b56cdd1fd6a with scrape type 2
2026-03-29 18:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9ea9934-f283-5868-8c91-7b56cdd1fd6a, identifier: WV16405
2026-03-29 18:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-29 18:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-29 18:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537 to the API
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:17:04Z',
'fuel_type': 'diesel',
'id': 'fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX08537',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 211393,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-03',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
'transmission': 'automatic',
'trim': 'Style blue 2WD',
'year': 2017}
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-29 18:43:34 [auto1.de] INFO: Saving data for FX08537: {'auction_closing_time': 1774883824.0, 'created_time': 1774292788.054162, 'last_price_update_time': 1774809814.526808}
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX08537') HTTP/1.1" 204 0
2026-03-29 18:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-29 18:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-29 18:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405 to the API
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:08:14Z',
'fuel_type': 'diesel',
'id': 'a9ea9934-f283-5868-8c91-7b56cdd1fd6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV16405',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 128224,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-11',
'seller_name': None,
'title': 'BMW 3er 320d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2019}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Saving data for WV16405: {'auction_closing_time': 1774883294.0, 'created_time': 1773859008.536862, 'last_price_update_time': 1774809815.014697}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV16405') HTTP/1.1" 204 0
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Scrape type for RW84791: 2
2026-03-29 18:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-29 18:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0771a0-fadd-589a-8c26-6732aeac7bcd with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0771a0-fadd-589a-8c26-6732aeac7bcd with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec0771a0-fadd-589a-8c26-6732aeac7bcd, identifier: RW84791
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Scrape type for BT49963: 0
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-29 18:43:35 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Scrape type for SA68147: 2
2026-03-29 18:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-29 18:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with scrape type 2
2026-03-29 18:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0, identifier: SA68147
2026-03-29 18:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-29 18:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-29 18:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791 to the API
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:43Z',
'fuel_type': 'diesel',
'id': 'ec0771a0-fadd-589a-8c26-6732aeac7bcd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW84791',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 98258,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-17',
'seller_name': None,
'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
'transmission': 'automatic',
'trim': 'clean diesel',
'year': 2016}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-29 18:43:35 [auto1.de] INFO: Saving data for RW84791: {'auction_closing_time': 1774884643.0, 'created_time': 1773861770.607587, 'last_price_update_time': 1774809815.60121}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW84791') HTTP/1.1" 204 0
2026-03-29 18:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-29 18:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-29 18:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147 to the API
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:42:52Z',
'fuel_type': 'diesel',
'id': '2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA68147',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 167646,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-03',
'seller_name': None,
'title': 'BMW 2er 214d Active Tourer Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2015}
2026-03-29 18:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Saving data for SA68147: {'auction_closing_time': 1774885372.0, 'created_time': 1773224388.456892, 'last_price_update_time': 1774809816.00151}
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA68147') HTTP/1.1" 204 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for VB58565: 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for EK27182: 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for ZJ06184: 2
2026-03-29 18:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-29 18:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with scrape type 2
2026-03-29 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with scrape type 2
2026-03-29 18:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2, identifier: ZJ06184
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for PR32105: 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-29 18:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-29 18:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184
2026-03-29 18:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a41e0dfb-aba5-5720-8e88-ddac7d34d0f2 with identifier: ZJ06184 to the API
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:28Z',
'fuel_type': 'petrol',
'id': 'a41e0dfb-aba5-5720-8e88-ddac7d34d0f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ06184',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 38802,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-12',
'seller_name': None,
'title': 'Dacia Duster 1.3 TCe Extreme',
'transmission': 'automatic',
'trim': 'Extreme',
'year': 2024}
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Saving data for ZJ06184: {'auction_closing_time': 1774884208.0, 'created_time': 1774521559.878471, 'last_price_update_time': 1774809816.471537}
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ06184') HTTP/1.1" 204 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for MS67551: 0
2026-03-29 18:43:36 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-29 18:43:36 [auto1.de] INFO: Scrape type for BU48960: 2
2026-03-29 18:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-29 18:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a3dd8e-5578-5352-8644-f125f393ccfe with scrape type 2
2026-03-29 18:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a3dd8e-5578-5352-8644-f125f393ccfe with scrape type 2
2026-03-29 18:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92a3dd8e-5578-5352-8644-f125f393ccfe, identifier: BU48960
2026-03-29 18:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-29 18:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-29 18:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960 to the API
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:11:24Z',
'fuel_type': 'diesel',
'id': '92a3dd8e-5578-5352-8644-f125f393ccfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU48960',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 52927,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-09',
'seller_name': None,
'title': 'Opel Vivaro 1.6 CDTI Kasten L1H1 2,7t',
'transmission': 'manual',
'trim': 'Kasten L1H1 2,7t',
'year': 2018}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Saving data for BU48960: {'auction_closing_time': 1774883484.0, 'created_time': 1774608507.813317, 'last_price_update_time': 1774809817.022243}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU48960') HTTP/1.1" 204 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for NL59666: 2
2026-03-29 18:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-29 18:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4466ed50-5955-5583-a8aa-05d304311dea, identifier: NL59666
2026-03-29 18:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-29 18:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-29 18:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666 to the API
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:04:44Z',
'fuel_type': 'diesel',
'id': '4466ed50-5955-5583-a8aa-05d304311dea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL59666',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 286049,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-08',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2016}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Saving data for NL59666: {'auction_closing_time': 1774883084.0, 'created_time': 1774608195.746186, 'last_price_update_time': 1774809817.457446}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL59666') HTTP/1.1" 204 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for ZW20696: 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for RP15707: 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Scrape type for SF33056: 2
2026-03-29 18:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-29 18:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888b1695-1cc5-5889-b6b7-4445200e45b4 with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 888b1695-1cc5-5889-b6b7-4445200e45b4 with scrape type 2
2026-03-29 18:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 888b1695-1cc5-5889-b6b7-4445200e45b4, identifier: SF33056
2026-03-29 18:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-29 18:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-29 18:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056 to the API
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:12:24Z',
'fuel_type': 'petrol',
'id': '888b1695-1cc5-5889-b6b7-4445200e45b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF33056',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 40286,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-07',
'seller_name': None,
'title': 'Hyundai i10 1.2 Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2012}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-29 18:43:37 [auto1.de] INFO: Saving data for SF33056: {'auction_closing_time': 1774883544.0, 'created_time': 1773302822.228211, 'last_price_update_time': 1774809817.964776}
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF33056') HTTP/1.1" 204 0
2026-03-29 18:43:37 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-29 18:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for ZV16812: 2
2026-03-29 18:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-29 18:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6edd53f7-01e8-545c-81f6-f90a66a24b4d with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6edd53f7-01e8-545c-81f6-f90a66a24b4d with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6edd53f7-01e8-545c-81f6-f90a66a24b4d, identifier: ZV16812
2026-03-29 18:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-29 18:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-29 18:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812 to the API
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:59:42Z',
'fuel_type': 'petrol',
'id': '6edd53f7-01e8-545c-81f6-f90a66a24b4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV16812',
'listing': 'auction',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 143767,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-07',
'seller_name': None,
'title': 'Skoda Karoq 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Saving data for ZV16812: {'auction_closing_time': 1774886382.0, 'created_time': 1773945887.9383, 'last_price_update_time': 1774809818.409719}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV16812') HTTP/1.1" 204 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for CR33136: 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for FB95771: 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for TH26087: 2
2026-03-29 18:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-29 18:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92172397-a815-5672-a7d9-fb09af2f7bbd with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92172397-a815-5672-a7d9-fb09af2f7bbd with scrape type 2
2026-03-29 18:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92172397-a815-5672-a7d9-fb09af2f7bbd, identifier: TH26087
2026-03-29 18:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-29 18:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-29 18:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087 to the API
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:33:36Z',
'fuel_type': 'petrol',
'id': '92172397-a815-5672-a7d9-fb09af2f7bbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH26087',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 138024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-31',
'seller_name': None,
'title': 'Seat Ibiza 1.2 Stylance / Style',
'transmission': 'manual',
'trim': 'Stylance / Style',
'year': 2009}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Saving data for TH26087: {'auction_closing_time': 1774884816.0, 'created_time': 1773689134.606667, 'last_price_update_time': 1774809818.872033}
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH26087') HTTP/1.1" 204 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-29 18:43:38 [auto1.de] INFO: Scrape type for EB29224: 0
2026-03-29 18:43:38 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Scrape type for KT29520: 2
2026-03-29 18:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-29 18:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eee42b4-2ad0-567f-a8dd-08305af2d577 with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eee42b4-2ad0-567f-a8dd-08305af2d577 with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eee42b4-2ad0-567f-a8dd-08305af2d577, identifier: KT29520
2026-03-29 18:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-29 18:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-29 18:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520 to the API
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:34:15Z',
'fuel_type': 'hybrid',
'id': '6eee42b4-2ad0-567f-a8dd-08305af2d577',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT29520',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 40379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-18',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
'transmission': 'automatic',
'trim': '4 300 GT',
'year': 2022}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Saving data for KT29520: {'auction_closing_time': 1774884855.0, 'created_time': 1774607812.845102, 'last_price_update_time': 1774809819.45089}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT29520') HTTP/1.1" 204 0
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Scrape type for UD17125: 0
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Scrape type for VU07666: 2
2026-03-29 18:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-29 18:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3827f639-5d5e-5139-b41b-3c23f81f2347 with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3827f639-5d5e-5139-b41b-3c23f81f2347 with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3827f639-5d5e-5139-b41b-3c23f81f2347, identifier: VU07666
2026-03-29 18:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-29 18:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-29 18:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666 to the API
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-30T15:45:47Z',
'fuel_type': 'petrol',
'id': '3827f639-5d5e-5139-b41b-3c23f81f2347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU07666',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 24791,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-24',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
'transmission': 'automatic',
'trim': 'Stepway Comfort',
'year': 2021}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Saving data for VU07666: {'auction_closing_time': 1774885547.0, 'created_time': 1773946057.757767, 'last_price_update_time': 1774809819.938445}
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU07666') HTTP/1.1" 204 0
2026-03-29 18:43:39 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-29 18:43:39 [auto1.de] INFO: Scrape type for EZ36931: 2
2026-03-29 18:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-29 18:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with scrape type 2
2026-03-29 18:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with scrape type 2
2026-03-29 18:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063, identifier: EZ36931
2026-03-29 18:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-29 18:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-29 18:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931 to the API
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:27:51Z',
'fuel_type': 'petrol',
'id': 'b4c87d2b-ec2b-582f-8d87-0ed90b4e0063',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ36931',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 97885,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-11-11',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2007}
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Saving data for EZ36931: {'auction_closing_time': 1774884471.0, 'created_time': 1772728533.609466, 'last_price_update_time': 1774809820.475178}
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ36931') HTTP/1.1" 204 0
2026-03-29 18:43:40 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:40 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-29 18:43:40 [auto1.de] INFO: Scrape type for JZ27200: 2
2026-03-29 18:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-29 18:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with scrape type 2
2026-03-29 18:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with scrape type 2
2026-03-29 18:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae, identifier: JZ27200
2026-03-29 18:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-29 18:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-29 18:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200 to the API
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:11Z',
'fuel_type': 'diesel',
'id': '8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ27200',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 198394,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-28',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-29 18:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Saving data for JZ27200: {'auction_closing_time': 1774885811.0, 'created_time': 1774608578.564494, 'last_price_update_time': 1774809821.008075}
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ27200') HTTP/1.1" 204 0
2026-03-29 18:43:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Scrape type for RD90003: 2
2026-03-29 18:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-29 18:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e28ca1b8-ac01-5dd1-8a88-c297b1710988 with scrape type 2
2026-03-29 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e28ca1b8-ac01-5dd1-8a88-c297b1710988 with scrape type 2
2026-03-29 18:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e28ca1b8-ac01-5dd1-8a88-c297b1710988, identifier: RD90003
2026-03-29 18:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-29 18:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003
2026-03-29 18:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e28ca1b8-ac01-5dd1-8a88-c297b1710988 with identifier: RD90003 to the API
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:00:38Z',
'fuel_type': 'petrol',
'id': 'e28ca1b8-ac01-5dd1-8a88-c297b1710988',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD90003',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 76273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-25',
'seller_name': None,
'title': 'BMW 3er 335i',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Saving data for RD90003: {'auction_closing_time': 1774882838.0, 'created_time': 1773945959.49454, 'last_price_update_time': 1774809821.500481}
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD90003') HTTP/1.1" 204 0
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Scrape type for NS17316: 0
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Scrape type for UA79270: 0
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Scrape type for HT34266: 0
2026-03-29 18:43:41 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-29 18:43:41 [auto1.de] INFO: Scrape type for CK62580: 2
2026-03-29 18:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-29 18:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with scrape type 2
2026-03-29 18:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with scrape type 2
2026-03-29 18:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76, identifier: CK62580
2026-03-29 18:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-29 18:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-29 18:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580 to the API
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:10:52Z',
'fuel_type': 'petrol',
'id': '08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK62580',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 95626,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-28',
'seller_name': None,
'title': 'Fiat Panda 1.2 MyLive',
'transmission': 'manual',
'trim': 'MyLive',
'year': 2012}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Saving data for CK62580: {'auction_closing_time': 1774883452.0, 'created_time': 1774607828.159244, 'last_price_update_time': 1774809822.104746}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK62580') HTTP/1.1" 204 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for GA34239: 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for LS63557: 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for AS18464: 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for MD24708: 2
2026-03-29 18:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-29 18:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e52f448-d37d-5714-9374-c06bbaa8e935 with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e52f448-d37d-5714-9374-c06bbaa8e935 with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e52f448-d37d-5714-9374-c06bbaa8e935, identifier: MD24708
2026-03-29 18:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-29 18:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-29 18:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708 to the API
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:43:54Z',
'fuel_type': 'diesel',
'id': '3e52f448-d37d-5714-9374-c06bbaa8e935',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD24708',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 167802,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-09',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2014}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Saving data for MD24708: {'auction_closing_time': 1774885434.0, 'created_time': 1773775402.212362, 'last_price_update_time': 1774809822.608428}
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD24708') HTTP/1.1" 204 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for WE68456: 0
2026-03-29 18:43:42 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-29 18:43:42 [auto1.de] INFO: Scrape type for JH37191: 2
2026-03-29 18:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-29 18:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with scrape type 2
2026-03-29 18:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e, identifier: JH37191
2026-03-29 18:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-29 18:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-29 18:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191 to the API
2026-03-29 18:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:57:28Z',
'fuel_type': 'petrol',
'id': 'a1bd3a18-e3ab-51c4-be0b-f9150f153f4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH37191',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 123424,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-12',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2017}
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Saving data for JH37191: {'auction_closing_time': 1774886248.0, 'created_time': 1773305419.374864, 'last_price_update_time': 1774809823.201233}
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH37191') HTTP/1.1" 204 0
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Scrape type for GD48947: 2
2026-03-29 18:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-29 18:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74d3abc-421f-5100-aa4f-fbc197713ee8 with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e74d3abc-421f-5100-aa4f-fbc197713ee8 with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e74d3abc-421f-5100-aa4f-fbc197713ee8, identifier: GD48947
2026-03-29 18:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-29 18:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-29 18:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947 to the API
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:54:46Z',
'fuel_type': 'petrol',
'id': 'e74d3abc-421f-5100-aa4f-fbc197713ee8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD48947',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 106187,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-16',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Saving data for GD48947: {'auction_closing_time': 1774886086.0, 'created_time': 1773341710.167857, 'last_price_update_time': 1774809823.765456}
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD48947') HTTP/1.1" 204 0
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-29 18:43:43 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-29 18:43:43 [auto1.de] INFO: Scrape type for ZY13516: 2
2026-03-29 18:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-29 18:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a080e24-4ed6-588a-a4ab-8331d736c3ae with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a080e24-4ed6-588a-a4ab-8331d736c3ae with scrape type 2
2026-03-29 18:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a080e24-4ed6-588a-a4ab-8331d736c3ae, identifier: ZY13516
2026-03-29 18:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-29 18:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-29 18:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516 to the API
2026-03-29 18:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:15:42Z',
'fuel_type': 'petrol',
'id': '2a080e24-4ed6-588a-a4ab-8331d736c3ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY13516',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 251247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-22',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2018}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Saving data for ZY13516: {'auction_closing_time': 1774883742.0, 'created_time': 1773383143.923159, 'last_price_update_time': 1774809824.220773}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY13516') HTTP/1.1" 204 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for SB93381: 2
2026-03-29 18:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-29 18:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9925289e-67ef-51a3-84d2-bb86a3f5093c with scrape type 2
2026-03-29 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9925289e-67ef-51a3-84d2-bb86a3f5093c with scrape type 2
2026-03-29 18:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9925289e-67ef-51a3-84d2-bb86a3f5093c, identifier: SB93381
2026-03-29 18:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-29 18:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-29 18:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381 to the API
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:13:21Z',
'fuel_type': 'diesel',
'id': '9925289e-67ef-51a3-84d2-bb86a3f5093c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB93381',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 488170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-18',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Saving data for SB93381: {'auction_closing_time': 1774883601.0, 'created_time': 1773659355.284287, 'last_price_update_time': 1774809824.762613}
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB93381') HTTP/1.1" 204 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for VW18097: 0
2026-03-29 18:43:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:44 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for DS04882: 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for DF58718: 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for ND71699: 0
2026-03-29 18:43:44 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-29 18:43:44 [auto1.de] INFO: Scrape type for PT06802: 2
2026-03-29 18:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802
2026-03-29 18:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f08ea15-f122-5917-bb28-6d28a2170e40 with scrape type 2
2026-03-29 18:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f08ea15-f122-5917-bb28-6d28a2170e40 with scrape type 2
2026-03-29 18:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f08ea15-f122-5917-bb28-6d28a2170e40, identifier: PT06802
2026-03-29 18:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802
2026-03-29 18:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802
2026-03-29 18:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f08ea15-f122-5917-bb28-6d28a2170e40 with identifier: PT06802 to the API
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:08:54Z',
'fuel_type': 'diesel',
'id': '0f08ea15-f122-5917-bb28-6d28a2170e40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT06802',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 157435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-19',
'seller_name': None,
'title': 'BMW X1 sDrive 18d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2018}
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Saving data for PT06802: {'auction_closing_time': 1774883334.0, 'created_time': 1773341717.801121, 'last_price_update_time': 1774809825.365883}
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT06802') HTTP/1.1" 204 0
2026-03-29 18:43:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Scrape type for XC89129: 0
2026-03-29 18:43:45 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-29 18:43:45 [auto1.de] INFO: Scrape type for DV32986: 2
2026-03-29 18:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-29 18:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with scrape type 2
2026-03-29 18:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with scrape type 2
2026-03-29 18:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944, identifier: DV32986
2026-03-29 18:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-29 18:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-29 18:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986 to the API
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:17:51Z',
'fuel_type': 'petrol',
'id': 'c3d50fd0-7194-5dd9-a7a5-09d00fa6f944',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV32986',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 150564,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-13',
'seller_name': None,
'title': 'Fiat Panda 1.1 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2009}
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Saving data for DV32986: {'auction_closing_time': 1774883871.0, 'created_time': 1774608579.247262, 'last_price_update_time': 1774809826.034737}
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV32986') HTTP/1.1" 204 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for YR51740: 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for HK34206: 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for WA63684: 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for DK33698: 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for BX53792: 2
2026-03-29 18:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792
2026-03-29 18:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2e1ca8-bccc-5452-8bbb-396034b0b682 with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2e1ca8-bccc-5452-8bbb-396034b0b682 with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da2e1ca8-bccc-5452-8bbb-396034b0b682, identifier: BX53792
2026-03-29 18:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792
2026-03-29 18:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792
2026-03-29 18:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da2e1ca8-bccc-5452-8bbb-396034b0b682 with identifier: BX53792 to the API
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 114,
'expiration_date': '2026-03-30T15:06:17Z',
'fuel_type': 'petrol',
'id': 'da2e1ca8-bccc-5452-8bbb-396034b0b682',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX53792',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 64874,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-13',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI Style Maxi',
'transmission': 'automatic',
'trim': 'Style Maxi',
'year': 2021}
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Saving data for BX53792: {'auction_closing_time': 1774883177.0, 'created_time': 1774636545.749979, 'last_price_update_time': 1774809826.557347}
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX53792') HTTP/1.1" 204 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for AR87592: 0
2026-03-29 18:43:46 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-29 18:43:46 [auto1.de] INFO: Scrape type for RS40485: 2
2026-03-29 18:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-29 18:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with scrape type 2
2026-03-29 18:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2, identifier: RS40485
2026-03-29 18:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-29 18:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485
2026-03-29 18:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76b9b278-bbcc-58a8-9c0a-36292b7fd2a2 with identifier: RS40485 to the API
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:47:57Z',
'fuel_type': 'petrol',
'id': '76b9b278-bbcc-58a8-9c0a-36292b7fd2a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS40485',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 194739,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
'transmission': 'automatic',
'trim': 'GTI "Performance" BlueMotion',
'year': 2016}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Saving data for RS40485: {'auction_closing_time': 1774885677.0, 'created_time': 1774118528.496655, 'last_price_update_time': 1774809827.109103}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS40485') HTTP/1.1" 204 0
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Scrape type for FS76993: 2
2026-03-29 18:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-29 18:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d532b8-0c6e-5906-a5cb-993b1fc60640 with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23d532b8-0c6e-5906-a5cb-993b1fc60640 with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23d532b8-0c6e-5906-a5cb-993b1fc60640, identifier: FS76993
2026-03-29 18:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-29 18:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-29 18:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993 to the API
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:01:03Z',
'fuel_type': 'petrol',
'id': '23d532b8-0c6e-5906-a5cb-993b1fc60640',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS76993',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 193868,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-19',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Match BlueMotion',
'transmission': 'manual',
'trim': 'Match BlueMotion',
'year': 2012}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Saving data for FS76993: {'auction_closing_time': 1774882863.0, 'created_time': 1773775079.926346, 'last_price_update_time': 1774809827.546813}
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS76993') HTTP/1.1" 204 0
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-29 18:43:47 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-29 18:43:47 [auto1.de] INFO: Scrape type for FS96919: 2
2026-03-29 18:43:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-29 18:43:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with scrape type 2
2026-03-29 18:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c, identifier: FS96919
2026-03-29 18:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-29 18:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-29 18:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919 to the API
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:26:42Z',
'fuel_type': 'petrol',
'id': '11f5240c-8f9d-5c93-ab4c-1219b1cea46c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS96919',
'listing': 'auction',
'make': 'Daihatsu',
'model': 'Sirion',
'odometer': 128330,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-14',
'seller_name': None,
'title': 'Daihatsu Sirion 1.3',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Saving data for FS96919: {'auction_closing_time': 1774884402.0, 'created_time': 1773775082.393337, 'last_price_update_time': 1774809828.074108}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS96919') HTTP/1.1" 204 0
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Scrape type for MK56575: 2
2026-03-29 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-29 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c, identifier: MK56575
2026-03-29 18:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-29 18:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-29 18:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575 to the API
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:09:04Z',
'fuel_type': 'petrol',
'id': '77c88eb5-6b21-5377-9ddb-6ab76c7b326c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK56575',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 43203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-15',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Saving data for MK56575: {'auction_closing_time': 1774883344.0, 'created_time': 1774293595.117582, 'last_price_update_time': 1774809828.495901}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK56575') HTTP/1.1" 204 0
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Scrape type for SD35692: 0
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Scrape type for EA77246: 0
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-29 18:43:48 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Scrape type for XV26734: 2
2026-03-29 18:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-29 18:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b12246-b8ea-50fa-bd53-3d1639e4893d with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b12246-b8ea-50fa-bd53-3d1639e4893d with scrape type 2
2026-03-29 18:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26b12246-b8ea-50fa-bd53-3d1639e4893d, identifier: XV26734
2026-03-29 18:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-29 18:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-29 18:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734 to the API
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:46:25Z',
'fuel_type': 'diesel',
'id': '26b12246-b8ea-50fa-bd53-3d1639e4893d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV26734',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 167830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-13',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI X-Perience 4Drive',
'transmission': 'automatic',
'trim': 'X-Perience 4Drive',
'year': 2016}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-29 18:43:48 [auto1.de] INFO: Saving data for XV26734: {'auction_closing_time': 1774885585.0, 'created_time': 1773304377.066621, 'last_price_update_time': 1774809828.973188}
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV26734') HTTP/1.1" 204 0
2026-03-29 18:43:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:49 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for NG69344: 0
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for ZW88785: 0
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for EP74565: 0
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for LN38152: 2
2026-03-29 18:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-29 18:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7, identifier: LN38152
2026-03-29 18:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-29 18:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-29 18:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152 to the API
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:51:14Z',
'fuel_type': 'petrol',
'id': 'c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN38152',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 110118,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-28',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Saving data for LN38152: {'auction_closing_time': 1774885874.0, 'created_time': 1773229484.027555, 'last_price_update_time': 1774809829.735067}
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN38152') HTTP/1.1" 204 0
2026-03-29 18:43:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-29 18:43:49 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-29 18:43:49 [auto1.de] INFO: Scrape type for DN13458: 2
2026-03-29 18:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-29 18:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 658e31ff-5926-5c1e-878e-d24a5d33b43d with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 658e31ff-5926-5c1e-878e-d24a5d33b43d with scrape type 2
2026-03-29 18:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 658e31ff-5926-5c1e-878e-d24a5d33b43d, identifier: DN13458
2026-03-29 18:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-29 18:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-29 18:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458 to the API
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:12:52Z',
'fuel_type': 'petrol',
'id': '658e31ff-5926-5c1e-878e-d24a5d33b43d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN13458',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 174340,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-29',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 Tour Edition',
'transmission': 'manual',
'trim': 'Tour Edition',
'year': 2007}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Saving data for DN13458: {'auction_closing_time': 1774883572.0, 'created_time': 1774608590.887549, 'last_price_update_time': 1774809830.275327}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN13458') HTTP/1.1" 204 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for UG80172: 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for AC95378: 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for YS72291: 2
2026-03-29 18:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-29 18:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with scrape type 2
2026-03-29 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with scrape type 2
2026-03-29 18:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcd1e36-5f40-5674-bdb0-78a09c64f7c4, identifier: YS72291
2026-03-29 18:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-29 18:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-29 18:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291 to the API
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:20:58Z',
'fuel_type': 'diesel',
'id': 'afcd1e36-5f40-5674-bdb0-78a09c64f7c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS72291',
'listing': 'auction',
'make': 'Seat',
'model': 'Arona',
'odometer': 91799,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-20',
'seller_name': None,
'title': 'Seat Arona 1.6 TDI Xcellence',
'transmission': 'manual',
'trim': 'Xcellence',
'year': 2018}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Saving data for YS72291: {'auction_closing_time': 1774884058.0, 'created_time': 1773226157.857367, 'last_price_update_time': 1774809830.798193}
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS72291') HTTP/1.1" 204 0
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-29 18:43:50 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-29 18:43:50 [auto1.de] INFO: Scrape type for EJ83325: 2
2026-03-29 18:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-29 18:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad041a1-6711-5ad4-98a5-636fc7f72769 with scrape type 2
2026-03-29 18:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cad041a1-6711-5ad4-98a5-636fc7f72769 with scrape type 2
2026-03-29 18:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cad041a1-6711-5ad4-98a5-636fc7f72769, identifier: EJ83325
2026-03-29 18:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-29 18:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-29 18:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325 to the API
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:59:36Z',
'fuel_type': 'petrol',
'id': 'cad041a1-6711-5ad4-98a5-636fc7f72769',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ83325',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLB-Klasse',
'odometer': 31095,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-12',
'seller_name': None,
'title': 'Mercedes-Benz GLB-Klasse GLB 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Saving data for EJ83325: {'auction_closing_time': 1774886376.0, 'created_time': 1774608154.574378, 'last_price_update_time': 1774809831.28672}
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ83325') HTTP/1.1" 204 0
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Scrape type for HR97485: 2
2026-03-29 18:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-29 18:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb3055c5-de0b-5042-804a-6e47029758da with scrape type 2
2026-03-29 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb3055c5-de0b-5042-804a-6e47029758da with scrape type 2
2026-03-29 18:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb3055c5-de0b-5042-804a-6e47029758da, identifier: HR97485
2026-03-29 18:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-29 18:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-29 18:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485 to the API
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:57:43Z',
'fuel_type': 'petrol',
'id': 'bb3055c5-de0b-5042-804a-6e47029758da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR97485',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 189513,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-05',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2009}
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Saving data for HR97485: {'auction_closing_time': 1774886263.0, 'created_time': 1774608171.667674, 'last_price_update_time': 1774809831.859625}
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR97485') HTTP/1.1" 204 0
2026-03-29 18:43:51 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-29 18:43:51 [auto1.de] INFO: Scrape type for HY91019: 2
2026-03-29 18:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019
2026-03-29 18:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90541646-e078-58c3-993c-2b9fad0b9fee with scrape type 2
2026-03-29 18:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90541646-e078-58c3-993c-2b9fad0b9fee with scrape type 2
2026-03-29 18:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90541646-e078-58c3-993c-2b9fad0b9fee, identifier: HY91019
2026-03-29 18:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019
2026-03-29 18:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019
2026-03-29 18:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90541646-e078-58c3-993c-2b9fad0b9fee with identifier: HY91019 to the API
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:54:44Z',
'fuel_type': 'diesel',
'id': '90541646-e078-58c3-993c-2b9fad0b9fee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY91019',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 223433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-12',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.6 CDTI DPF Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Saving data for HY91019: {'auction_closing_time': 1774886084.0, 'created_time': 1774550143.984592, 'last_price_update_time': 1774809832.275913}
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY91019') HTTP/1.1" 204 0
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for PD62787: 0
2026-03-29 18:43:52 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Scrape type for EL68687: 2
2026-03-29 18:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-29 18:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36584fe8-f12d-5dab-b9be-feec72cec099 with scrape type 2
2026-03-29 18:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36584fe8-f12d-5dab-b9be-feec72cec099 with scrape type 2
2026-03-29 18:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36584fe8-f12d-5dab-b9be-feec72cec099, identifier: EL68687
2026-03-29 18:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-29 18:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-29 18:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687 to the API
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:06:17Z',
'fuel_type': 'petrol',
'id': '36584fe8-f12d-5dab-b9be-feec72cec099',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL68687',
'listing': 'auction',
'make': 'Lada',
'model': 'Kalina 2',
'odometer': 113754,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-14',
'seller_name': None,
'title': 'Lada Kalina 2 1.6 Luxus',
'transmission': 'manual',
'trim': 'Luxus',
'year': 2018}
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-29 18:43:52 [auto1.de] INFO: Saving data for EL68687: {'auction_closing_time': 1774883177.0, 'created_time': 1774290939.72187, 'last_price_update_time': 1774809832.731557}
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL68687') HTTP/1.1" 204 0
2026-03-29 18:43:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:53 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for ZY28796: 0
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for RB37125: 0
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for MG33600: 0
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for UA59851: 0
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for GN24423: 0
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-29 18:43:53 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-29 18:43:53 [auto1.de] INFO: Scrape type for SB28206: 2
2026-03-29 18:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-29 18:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with scrape type 2
2026-03-29 18:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with scrape type 2
2026-03-29 18:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33, identifier: SB28206
2026-03-29 18:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-29 18:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206
2026-03-29 18:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99764afe-bacb-5dcb-9d8b-3e41dfeabf33 with identifier: SB28206 to the API
2026-03-29 18:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 460,
'expiration_date': '2026-03-30T15:49:23Z',
'fuel_type': 'petrol',
'id': '99764afe-bacb-5dcb-9d8b-3e41dfeabf33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB28206',
'listing': 'auction',
'make': 'Porsche',
'model': 'Panamera',
'odometer': 96205,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-05',
'seller_name': None,
'title': 'Porsche Panamera GTS',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Saving data for SB28206: {'auction_closing_time': 1774885763.0, 'created_time': 1773427608.849925, 'last_price_update_time': 1774809834.171846}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB28206') HTTP/1.1" 204 0
2026-03-29 18:43:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for AN78451: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for MD27320: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for UW23884: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for EX93586: 2
2026-03-29 18:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-29 18:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af135d60-e418-55af-b1fa-1f4cb862f2d9 with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af135d60-e418-55af-b1fa-1f4cb862f2d9 with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af135d60-e418-55af-b1fa-1f4cb862f2d9, identifier: EX93586
2026-03-29 18:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-29 18:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-29 18:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586 to the API
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:51:48Z',
'fuel_type': 'petrol',
'id': 'af135d60-e418-55af-b1fa-1f4cb862f2d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX93586',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 85561,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-17',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Turbo HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2018}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Saving data for EX93586: {'auction_closing_time': 1774885908.0, 'created_time': 1773383145.111176, 'last_price_update_time': 1774809834.773267}
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX93586') HTTP/1.1" 204 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for CA65942: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for NV85283: 0
2026-03-29 18:43:54 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-29 18:43:54 [auto1.de] INFO: Scrape type for UY74953: 2
2026-03-29 18:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-29 18:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9721ed22-61f8-579a-86ea-8b999fbc939a with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9721ed22-61f8-579a-86ea-8b999fbc939a with scrape type 2
2026-03-29 18:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9721ed22-61f8-579a-86ea-8b999fbc939a, identifier: UY74953
2026-03-29 18:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-29 18:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953
2026-03-29 18:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9721ed22-61f8-579a-86ea-8b999fbc939a with identifier: UY74953 to the API
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:18Z',
'fuel_type': 'petrol',
'id': '9721ed22-61f8-579a-86ea-8b999fbc939a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY74953',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 116889,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-18',
'seller_name': None,
'title': 'Seat Leon 1.5 TSI ACT Xcellence',
'transmission': 'manual',
'trim': 'Xcellence',
'year': 2019}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Saving data for UY74953: {'auction_closing_time': 1774885578.0, 'created_time': 1774521387.225599, 'last_price_update_time': 1774809835.233974}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY74953') HTTP/1.1" 204 0
2026-03-29 18:43:55 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Scrape type for KP12697: 2
2026-03-29 18:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-29 18:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af85f408-3e5e-5540-9aab-d1b321ece4b1 with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af85f408-3e5e-5540-9aab-d1b321ece4b1 with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af85f408-3e5e-5540-9aab-d1b321ece4b1, identifier: KP12697
2026-03-29 18:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-29 18:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-29 18:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697 to the API
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:10:20Z',
'fuel_type': 'petrol',
'id': 'af85f408-3e5e-5540-9aab-d1b321ece4b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP12697',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 181041,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-06',
'seller_name': None,
'title': 'Suzuki Swift 1.2 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2011}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Saving data for KP12697: {'auction_closing_time': 1774883420.0, 'created_time': 1772544480.903056, 'last_price_update_time': 1774809835.754235}
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP12697') HTTP/1.1" 204 0
2026-03-29 18:43:55 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-29 18:43:55 [auto1.de] INFO: Scrape type for UB26055: 2
2026-03-29 18:43:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-29 18:43:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with scrape type 2
2026-03-29 18:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f, identifier: UB26055
2026-03-29 18:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-29 18:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-29 18:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055 to the API
2026-03-29 18:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:28:48Z',
'fuel_type': 'petrol',
'id': '4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB26055',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 120341,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-12',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2016}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Saving data for UB26055: {'auction_closing_time': 1774884528.0, 'created_time': 1774607802.946892, 'last_price_update_time': 1774809836.210598}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB26055') HTTP/1.1" 204 0
2026-03-29 18:43:56 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL71663%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Scrape type for VL71663: 2
2026-03-29 18:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663
2026-03-29 18:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e, identifier: VL71663
2026-03-29 18:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663
2026-03-29 18:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663
2026-03-29 18:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e with identifier: VL71663 to the API
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:44:40Z',
'fuel_type': 'petrol',
'id': '2ce6ffe8-8ffd-56c0-b65a-f6cb443c800e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL71663',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 75847,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-22',
'seller_name': None,
'title': 'Opel Corsa 1.4 Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2010}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL71663%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Saving data for VL71663: {'auction_closing_time': 1774885480.0, 'created_time': 1773399800.307125, 'last_price_update_time': 1774809836.604844}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL71663') HTTP/1.1" 204 0
2026-03-29 18:43:56 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Scrape type for JP54532: 2
2026-03-29 18:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532
2026-03-29 18:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea650558-1c08-5add-b2b7-ada85aaec06c with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea650558-1c08-5add-b2b7-ada85aaec06c with scrape type 2
2026-03-29 18:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea650558-1c08-5add-b2b7-ada85aaec06c, identifier: JP54532
2026-03-29 18:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532
2026-03-29 18:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532
2026-03-29 18:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea650558-1c08-5add-b2b7-ada85aaec06c with identifier: JP54532 to the API
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:58:09Z',
'fuel_type': 'diesel',
'id': 'ea650558-1c08-5add-b2b7-ada85aaec06c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP54532',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 137806,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-19',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-29 18:43:56 [auto1.de] INFO: Saving data for JP54532: {'auction_closing_time': 1774886289.0, 'created_time': 1774636655.872037, 'last_price_update_time': 1774809836.99534}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP54532') HTTP/1.1" 204 0
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Scrape type for NU40384: 2
2026-03-29 18:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-29 18:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2508733c-c736-5841-bf1b-aecfddd1804b with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2508733c-c736-5841-bf1b-aecfddd1804b with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2508733c-c736-5841-bf1b-aecfddd1804b, identifier: NU40384
2026-03-29 18:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-29 18:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-29 18:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384 to the API
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:52:36Z',
'fuel_type': 'diesel',
'id': '2508733c-c736-5841-bf1b-aecfddd1804b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU40384',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 214090,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-20',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Saving data for NU40384: {'auction_closing_time': 1774885956.0, 'created_time': 1773132508.486764, 'last_price_update_time': 1774809837.470435}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU40384') HTTP/1.1" 204 0
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Scrape type for GU60494: 0
2026-03-29 18:43:57 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-29 18:43:57 [auto1.de] INFO: Scrape type for DJ93554: 2
2026-03-29 18:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-29 18:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with scrape type 2
2026-03-29 18:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45bfcb05-cc85-56f2-95b4-9652f8e5b570, identifier: DJ93554
2026-03-29 18:43:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-29 18:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-29 18:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554 to the API
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:56:43Z',
'fuel_type': 'petrol',
'id': '45bfcb05-cc85-56f2-95b4-9652f8e5b570',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ93554',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 40873,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-28',
'seller_name': None,
'title': 'Audi A4 40 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-03-29 18:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Saving data for DJ93554: {'auction_closing_time': 1774886203.0, 'created_time': 1774607910.329623, 'last_price_update_time': 1774809838.00452}
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ93554') HTTP/1.1" 204 0
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Scrape type for MX70218: 0
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-29 18:43:58 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6740 | hits on page: 40
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Scrape type for EP31898: 0
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Scrape type for EE83336: 2
2026-03-29 18:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-29 18:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 772f1e3f-30a9-5257-ba44-451fe8bf54e0, identifier: EE83336
2026-03-29 18:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-29 18:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-29 18:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336 to the API
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-30T15:52:05Z',
'fuel_type': 'petrol',
'id': '772f1e3f-30a9-5257-ba44-451fe8bf54e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE83336',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4 S-Cross',
'odometer': 71217,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-22',
'seller_name': None,
'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort 4x4',
'transmission': 'manual',
'trim': 'Comfort 4x4',
'year': 2020}
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Saving data for EE83336: {'auction_closing_time': 1774885925.0, 'created_time': 1773861607.345471, 'last_price_update_time': 1774809838.502502}
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE83336') HTTP/1.1" 204 0
2026-03-29 18:43:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-29 18:43:58 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-29 18:43:58 [auto1.de] INFO: Scrape type for GE21325: 2
2026-03-29 18:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-29 18:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with scrape type 2
2026-03-29 18:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8, identifier: GE21325
2026-03-29 18:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-29 18:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-29 18:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325 to the API
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:26:16Z',
'fuel_type': 'petrol',
'id': '76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE21325',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 46070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-03',
'seller_name': None,
'title': 'Hyundai i30 2.0 T-GDI N Performance',
'transmission': 'automatic',
'trim': 'N Performance',
'year': 2023}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Saving data for GE21325: {'auction_closing_time': 1774884376.0, 'created_time': 1774293452.408471, 'last_price_update_time': 1774809839.079489}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE21325') HTTP/1.1" 204 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for XS82974: 2
2026-03-29 18:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974
2026-03-29 18:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff3586be-9a23-5b56-b884-b1a75f68d30d with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff3586be-9a23-5b56-b884-b1a75f68d30d with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff3586be-9a23-5b56-b884-b1a75f68d30d, identifier: XS82974
2026-03-29 18:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974
2026-03-29 18:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974
2026-03-29 18:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff3586be-9a23-5b56-b884-b1a75f68d30d with identifier: XS82974 to the API
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:23:33Z',
'fuel_type': 'petrol',
'id': 'ff3586be-9a23-5b56-b884-b1a75f68d30d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS82974',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 70814,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-30',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Soleil',
'transmission': 'manual',
'trim': 'Soleil',
'year': 2019}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Saving data for XS82974: {'auction_closing_time': 1774884213.0, 'created_time': 1773307592.426424, 'last_price_update_time': 1774809839.513286}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS82974') HTTP/1.1" 204 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for MJ31328: 2
2026-03-29 18:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328
2026-03-29 18:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b84099-821b-510d-88bb-cf736ad45bc1 with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b84099-821b-510d-88bb-cf736ad45bc1 with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44b84099-821b-510d-88bb-cf736ad45bc1, identifier: MJ31328
2026-03-29 18:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328
2026-03-29 18:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328
2026-03-29 18:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44b84099-821b-510d-88bb-cf736ad45bc1 with identifier: MJ31328 to the API
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:09:57Z',
'fuel_type': 'diesel',
'id': '44b84099-821b-510d-88bb-cf736ad45bc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ31328',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 136968,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-28',
'seller_name': None,
'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
'transmission': 'manual',
'trim': 'Highline BlueMotion',
'year': 2017}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Saving data for MJ31328: {'auction_closing_time': 1774883397.0, 'created_time': 1773916683.896658, 'last_price_update_time': 1774809839.918034}
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ31328') HTTP/1.1" 204 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for AE81199: 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for DT53290: 0
2026-03-29 18:43:59 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-29 18:43:59 [auto1.de] INFO: Scrape type for XV53612: 2
2026-03-29 18:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-29 18:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d08b116-37b6-5019-9c84-dc6091f31c13 with scrape type 2
2026-03-29 18:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d08b116-37b6-5019-9c84-dc6091f31c13 with scrape type 2
2026-03-29 18:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d08b116-37b6-5019-9c84-dc6091f31c13, identifier: XV53612
2026-03-29 18:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-29 18:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-29 18:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612 to the API
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:33:28Z',
'fuel_type': 'hybrid',
'id': '1d08b116-37b6-5019-9c84-dc6091f31c13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV53612',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 59935,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-19',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2022}
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Saving data for XV53612: {'auction_closing_time': 1774884808.0, 'created_time': 1773400172.608221, 'last_price_update_time': 1774809840.502474}
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV53612') HTTP/1.1" 204 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for FJ72456: 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for ZP66388: 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for HJ28276: 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for YJ21750: 0
2026-03-29 18:44:00 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-29 18:44:00 [auto1.de] INFO: Scrape type for YH44643: 2
2026-03-29 18:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-29 18:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with scrape type 2
2026-03-29 18:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with scrape type 2
2026-03-29 18:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e0e204-c581-50ff-a6d4-9e7c2b92be50, identifier: YH44643
2026-03-29 18:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-29 18:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-29 18:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643 to the API
2026-03-29 18:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:33:37Z',
'fuel_type': 'petrol',
'id': '39e0e204-c581-50ff-a6d4-9e7c2b92be50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH44643',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 88326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-19',
'seller_name': None,
'title': 'Ford S-Max 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Saving data for YH44643: {'auction_closing_time': 1774884817.0, 'created_time': 1774262620.755654, 'last_price_update_time': 1774809841.130805}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH44643') HTTP/1.1" 204 0
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Scrape type for JJ72083: 2
2026-03-29 18:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-29 18:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34afeef-5117-56ec-9dae-070513927659 with scrape type 2
2026-03-29 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c34afeef-5117-56ec-9dae-070513927659 with scrape type 2
2026-03-29 18:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c34afeef-5117-56ec-9dae-070513927659, identifier: JJ72083
2026-03-29 18:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-29 18:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-29 18:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083 to the API
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:13:29Z',
'fuel_type': 'diesel',
'id': 'c34afeef-5117-56ec-9dae-070513927659',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ72083',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 154163,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-28',
'seller_name': None,
'title': 'BMW 5er 535d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2015}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Saving data for JJ72083: {'auction_closing_time': 1774883609.0, 'created_time': 1774350245.897141, 'last_price_update_time': 1774809841.643347}
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ72083') HTTP/1.1" 204 0
2026-03-29 18:44:01 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-29 18:44:01 [auto1.de] INFO: Scrape type for PT78073: 2
2026-03-29 18:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-29 18:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595e6759-546d-5b7d-b185-268441999091 with scrape type 2
2026-03-29 18:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 595e6759-546d-5b7d-b185-268441999091 with scrape type 2
2026-03-29 18:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 595e6759-546d-5b7d-b185-268441999091, identifier: PT78073
2026-03-29 18:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-29 18:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-29 18:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073 to the API
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:23:33Z',
'fuel_type': 'petrol',
'id': '595e6759-546d-5b7d-b185-268441999091',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT78073',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 32849,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-11',
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2024}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Saving data for PT78073: {'auction_closing_time': 1774884213.0, 'created_time': 1773305116.950431, 'last_price_update_time': 1774809842.088469}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT78073') HTTP/1.1" 204 0
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Scrape type for JP08522: 2
2026-03-29 18:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-29 18:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a10737-a574-5160-975e-4171b70477a8 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a10737-a574-5160-975e-4171b70477a8 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a10737-a574-5160-975e-4171b70477a8, identifier: JP08522
2026-03-29 18:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-29 18:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-29 18:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522 to the API
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:40Z',
'fuel_type': 'petrol',
'id': '13a10737-a574-5160-975e-4171b70477a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP08522',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 54082,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-01',
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2021}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Saving data for JP08522: {'auction_closing_time': 1774883620.0, 'created_time': 1774608463.639286, 'last_price_update_time': 1774809842.686415}
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP08522') HTTP/1.1" 204 0
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-29 18:44:02 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-29 18:44:02 [auto1.de] INFO: Scrape type for CN91045: 2
2026-03-29 18:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-03-29 18:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9f807-30ca-590c-a7a9-913ce2c6a807 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af9f807-30ca-590c-a7a9-913ce2c6a807 with scrape type 2
2026-03-29 18:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af9f807-30ca-590c-a7a9-913ce2c6a807, identifier: CN91045
2026-03-29 18:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-03-29 18:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045
2026-03-29 18:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af9f807-30ca-590c-a7a9-913ce2c6a807 with identifier: CN91045 to the API
2026-03-29 18:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:51:18Z',
'fuel_type': 'petrol',
'id': '0af9f807-30ca-590c-a7a9-913ce2c6a807',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN91045',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 136643,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-18',
'seller_name': None,
'title': 'Opel Corsa 1.2 150 Jahre Opel',
'transmission': 'manual',
'trim': '150 Jahre',
'year': 2012}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Saving data for CN91045: {'auction_closing_time': 1774885878.0, 'created_time': 1773945746.769541, 'last_price_update_time': 1774809843.180231}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN91045') HTTP/1.1" 204 0
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Scrape type for YC44419: 0
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Scrape type for CX18884: 2
2026-03-29 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884
2026-03-29 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32, identifier: CX18884
2026-03-29 18:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884
2026-03-29 18:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884
2026-03-29 18:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32 with identifier: CX18884 to the API
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:45:14Z',
'fuel_type': 'diesel',
'id': 'c80c4d6d-31b8-5e77-8f7a-eabf5afa7c32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX18884',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 151166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-02',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition 4x4',
'transmission': 'manual',
'trim': 'Ambition 4x4',
'year': 2016}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Saving data for CX18884: {'auction_closing_time': 1774885514.0, 'created_time': 1774034375.286087, 'last_price_update_time': 1774809843.60658}
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX18884') HTTP/1.1" 204 0
2026-03-29 18:44:03 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:03 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-29 18:44:03 [auto1.de] INFO: Scrape type for MM29891: 2
2026-03-29 18:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-29 18:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with scrape type 2
2026-03-29 18:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2, identifier: MM29891
2026-03-29 18:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-29 18:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-29 18:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891 to the API
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:52:45Z',
'fuel_type': 'diesel',
'id': '8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM29891',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 77208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-14',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Saving data for MM29891: {'auction_closing_time': 1774885965.0, 'created_time': 1774293920.003838, 'last_price_update_time': 1774809844.083177}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM29891') HTTP/1.1" 204 0
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Scrape type for MC57954: 0
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Scrape type for CD36219: 2
2026-03-29 18:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-29 18:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47a2dfd1-58f1-5510-aa50-f467d04c87c5, identifier: CD36219
2026-03-29 18:44:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Scrape type for WZ42381: 0
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Scrape type for VJ82092: 0
2026-03-29 18:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-29 18:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-29 18:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219 to the API
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:18:53Z',
'fuel_type': 'petrol',
'id': '47a2dfd1-58f1-5510-aa50-f467d04c87c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD36219',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 112948,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-20',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2011}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Saving data for CD36219: {'auction_closing_time': 1774883933.0, 'created_time': 1773382997.07571, 'last_price_update_time': 1774809844.649378}
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD36219') HTTP/1.1" 204 0
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-29 18:44:04 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-29 18:44:04 [auto1.de] INFO: Scrape type for VV03695: 2
2026-03-29 18:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-29 18:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764d0d0e-80d8-5831-b147-5d81d0335d48 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764d0d0e-80d8-5831-b147-5d81d0335d48 with scrape type 2
2026-03-29 18:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764d0d0e-80d8-5831-b147-5d81d0335d48, identifier: VV03695
2026-03-29 18:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-29 18:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-29 18:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695 to the API
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:50:28Z',
'fuel_type': 'petrol',
'id': '764d0d0e-80d8-5831-b147-5d81d0335d48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV03695',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 116170,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-15',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Saving data for VV03695: {'auction_closing_time': 1774885828.0, 'created_time': 1773831719.042165, 'last_price_update_time': 1774809845.230141}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV03695') HTTP/1.1" 204 0
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Scrape type for MV92494: 0
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Scrape type for AE71125: 2
2026-03-29 18:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-29 18:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b489831-986d-54d2-a55c-242345021697 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b489831-986d-54d2-a55c-242345021697 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b489831-986d-54d2-a55c-242345021697, identifier: AE71125
2026-03-29 18:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-29 18:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-29 18:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125 to the API
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:40:30Z',
'fuel_type': 'diesel',
'id': '2b489831-986d-54d2-a55c-242345021697',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE71125',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 248477,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-01',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Edition Classic',
'transmission': 'manual',
'trim': 'T BlueEfficiency Edition Classic',
'year': 2014}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Saving data for AE71125: {'auction_closing_time': 1774885230.0, 'created_time': 1774293902.057252, 'last_price_update_time': 1774809845.752874}
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE71125') HTTP/1.1" 204 0
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-29 18:44:05 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-29 18:44:05 [auto1.de] INFO: Scrape type for RP65815: 2
2026-03-29 18:44:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815
2026-03-29 18:44:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with scrape type 2
2026-03-29 18:44:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c74e39d6-1e5d-5c78-824b-6fbb34392ee6, identifier: RP65815
2026-03-29 18:44:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815
2026-03-29 18:44:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815
2026-03-29 18:44:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c74e39d6-1e5d-5c78-824b-6fbb34392ee6 with identifier: RP65815 to the API
2026-03-29 18:44:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:13:05Z',
'fuel_type': 'diesel',
'id': 'c74e39d6-1e5d-5c78-824b-6fbb34392ee6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP65815',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 331867,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-27',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2008}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Saving data for RP65815: {'auction_closing_time': 1774883585.0, 'created_time': 1774550186.889014, 'last_price_update_time': 1774809846.173407}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP65815') HTTP/1.1" 204 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for TS05974: 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for MJ41620: 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for HV65540: 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for NH86896: 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for CU80256: 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for ME33936: 0
2026-03-29 18:44:06 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Scrape type for DG19497: 2
2026-03-29 18:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-29 18:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c60f48c-22d3-5757-b4e3-533f77f027f0 with scrape type 2
2026-03-29 18:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c60f48c-22d3-5757-b4e3-533f77f027f0 with scrape type 2
2026-03-29 18:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c60f48c-22d3-5757-b4e3-533f77f027f0, identifier: DG19497
2026-03-29 18:44:06 [scrapy.extensions.logstats] INFO: Crawled 107 pages (at 11 pages/min), scraped 891 items (at 116 items/min)
2026-03-29 18:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-29 18:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-29 18:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497 to the API
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:20:34Z',
'fuel_type': 'diesel',
'id': '9c60f48c-22d3-5757-b4e3-533f77f027f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG19497',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Arteon Shooting Brake',
'odometer': 64528,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-31',
'seller_name': None,
'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-29 18:44:06 [auto1.de] INFO: Saving data for DG19497: {'auction_closing_time': 1774884034.0, 'created_time': 1773306129.995433, 'last_price_update_time': 1774809846.894643}
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG19497') HTTP/1.1" 204 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for WV38848: 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for CB80286: 2
2026-03-29 18:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-29 18:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7b28fe-d7cf-5fd1-b6af-a22385996986, identifier: CB80286
2026-03-29 18:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-29 18:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-29 18:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286 to the API
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:20Z',
'fuel_type': 'diesel',
'id': '9c7b28fe-d7cf-5fd1-b6af-a22385996986',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB80286',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 237006,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-16',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Saving data for CB80286: {'auction_closing_time': 1774882880.0, 'created_time': 1773830157.529888, 'last_price_update_time': 1774809847.49544}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB80286') HTTP/1.1" 204 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for RH59786: 2
2026-03-29 18:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786
2026-03-29 18:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5, identifier: RH59786
2026-03-29 18:44:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786
2026-03-29 18:44:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786
2026-03-29 18:44:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d5d2bbf-0582-56ee-9195-0e9f85242ec5 with identifier: RH59786 to the API
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:59:23Z',
'fuel_type': 'petrol',
'id': '7d5d2bbf-0582-56ee-9195-0e9f85242ec5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH59786',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 47414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-15',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2021}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Saving data for RH59786: {'auction_closing_time': 1774886363.0, 'created_time': 1774636703.76946, 'last_price_update_time': 1774809847.907491}
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH59786') HTTP/1.1" 204 0
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-29 18:44:07 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-29 18:44:07 [auto1.de] INFO: Scrape type for LG97713: 2
2026-03-29 18:44:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-29 18:44:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b35e4167-adde-526d-894f-cb321b7beb29 with scrape type 2
2026-03-29 18:44:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b35e4167-adde-526d-894f-cb321b7beb29 with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b35e4167-adde-526d-894f-cb321b7beb29, identifier: LG97713
2026-03-29 18:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-29 18:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713
2026-03-29 18:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b35e4167-adde-526d-894f-cb321b7beb29 with identifier: LG97713 to the API
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:08:22Z',
'fuel_type': 'petrol',
'id': 'b35e4167-adde-526d-894f-cb321b7beb29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG97713',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 178105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-21',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Saving data for LG97713: {'auction_closing_time': 1774883302.0, 'created_time': 1773383640.909864, 'last_price_update_time': 1774809848.335769}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG97713') HTTP/1.1" 204 0
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Scrape type for RX21744: 2
2026-03-29 18:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-29 18:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb, identifier: RX21744
2026-03-29 18:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-29 18:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-29 18:44:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744 to the API
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:26:28Z',
'fuel_type': 'diesel',
'id': 'b1e65f0b-0d8f-5dcb-972b-bd305a595ddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX21744',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 277115,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-17',
'seller_name': None,
'title': 'Peugeot 3008 1.6 e-HDi Business-Line',
'transmission': 'automatic',
'trim': 'Business-Line',
'year': 2013}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Saving data for RX21744: {'auction_closing_time': 1774884388.0, 'created_time': 1773429007.339156, 'last_price_update_time': 1774809848.80786}
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX21744') HTTP/1.1" 204 0
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Scrape type for HN24396: 0
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Scrape type for PS84197: 0
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-29 18:44:08 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-29 18:44:08 [auto1.de] INFO: Scrape type for KD49468: 2
2026-03-29 18:44:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-29 18:44:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491f0b8c-14be-5293-9969-448106eac0c7 with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491f0b8c-14be-5293-9969-448106eac0c7 with scrape type 2
2026-03-29 18:44:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 491f0b8c-14be-5293-9969-448106eac0c7, identifier: KD49468
2026-03-29 18:44:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-29 18:44:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-29 18:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468 to the API
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:39:08Z',
'fuel_type': 'petrol',
'id': '491f0b8c-14be-5293-9969-448106eac0c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD49468',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 98321,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-28',
'seller_name': None,
'title': 'Renault Espace 1.8 TCe Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2018}
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-29 18:44:09 [auto1.de] INFO: Saving data for KD49468: {'auction_closing_time': 1774885148.0, 'created_time': 1774292315.787011, 'last_price_update_time': 1774809849.296092}
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD49468') HTTP/1.1" 204 0
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-29 18:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:09 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:09 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-29 18:44:09 [auto1.de] INFO: Scrape type for UD17279: 2
2026-03-29 18:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-29 18:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with scrape type 2
2026-03-29 18:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d, identifier: UD17279
2026-03-29 18:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-29 18:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-29 18:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279 to the API
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:36:21Z',
'fuel_type': 'diesel',
'id': '1f510f9e-3b00-5b5c-83d4-63ca840c9e2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD17279',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 99043,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-08',
'seller_name': None,
'title': 'Audi A6 40 TDI Mild-Hybrid quattro Design',
'transmission': 'automatic',
'trim': 'quattro Design',
'year': 2020}
2026-03-29 18:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Saving data for UD17279: {'auction_closing_time': 1774884981.0, 'created_time': 1773688896.123319, 'last_price_update_time': 1774809850.001857}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD17279') HTTP/1.1" 204 0
2026-03-29 18:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Scrape type for MV56275: 2
2026-03-29 18:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-29 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6189e685-b492-5397-8129-9f814bfe874c with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6189e685-b492-5397-8129-9f814bfe874c with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6189e685-b492-5397-8129-9f814bfe874c, identifier: MV56275
2026-03-29 18:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-29 18:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275
2026-03-29 18:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6189e685-b492-5397-8129-9f814bfe874c with identifier: MV56275 to the API
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:00:51Z',
'fuel_type': 'petrol',
'id': '6189e685-b492-5397-8129-9f814bfe874c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV56275',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 151634,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-30',
'seller_name': None,
'title': 'Honda Jazz 1.2 S',
'transmission': 'manual',
'trim': 'S',
'year': 2011}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Saving data for MV56275: {'auction_closing_time': 1774882851.0, 'created_time': 1774521560.807268, 'last_price_update_time': 1774809850.443447}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV56275') HTTP/1.1" 204 0
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Scrape type for AG53647: 2
2026-03-29 18:44:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-29 18:44:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 284816dc-12a7-55b7-bbee-4c7e07c556db with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 284816dc-12a7-55b7-bbee-4c7e07c556db with scrape type 2
2026-03-29 18:44:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 284816dc-12a7-55b7-bbee-4c7e07c556db, identifier: AG53647
2026-03-29 18:44:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-29 18:44:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-29 18:44:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647 to the API
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:27:43Z',
'fuel_type': 'diesel',
'id': '284816dc-12a7-55b7-bbee-4c7e07c556db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG53647',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 248853,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-22',
'seller_name': None,
'title': 'BMW 3er 330d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-29 18:44:10 [auto1.de] INFO: Saving data for AG53647: {'auction_closing_time': 1774884463.0, 'created_time': 1774380863.864437, 'last_price_update_time': 1774809850.968033}
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG53647') HTTP/1.1" 204 0
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-29 18:44:10 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-29 18:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for MR73613: 0
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for TE18178: 2
2026-03-29 18:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-29 18:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79dffafe-0f64-5b51-9798-089d607e652c with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79dffafe-0f64-5b51-9798-089d607e652c with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79dffafe-0f64-5b51-9798-089d607e652c, identifier: TE18178
2026-03-29 18:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-29 18:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178
2026-03-29 18:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79dffafe-0f64-5b51-9798-089d607e652c with identifier: TE18178 to the API
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:20:54Z',
'fuel_type': 'diesel',
'id': '79dffafe-0f64-5b51-9798-089d607e652c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE18178',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 165027,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-27',
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
'transmission': 'manual',
'trim': 'Allure L1',
'year': 2020}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Saving data for TE18178: {'auction_closing_time': 1774884054.0, 'created_time': 1774522019.192393, 'last_price_update_time': 1774809851.427662}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE18178') HTTP/1.1" 204 0
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for UR77332: 0
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for GZ76571: 0
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for TA92521: 0
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for JM70147: 0
2026-03-29 18:44:11 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Scrape type for LA13205: 2
2026-03-29 18:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-29 18:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e3a79fc-f092-5a6f-9873-aa603862f30e with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e3a79fc-f092-5a6f-9873-aa603862f30e with scrape type 2
2026-03-29 18:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e3a79fc-f092-5a6f-9873-aa603862f30e, identifier: LA13205
2026-03-29 18:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-29 18:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205
2026-03-29 18:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e3a79fc-f092-5a6f-9873-aa603862f30e with identifier: LA13205 to the API
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:45:58Z',
'fuel_type': 'petrol',
'id': '3e3a79fc-f092-5a6f-9873-aa603862f30e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA13205',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 28601,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-23',
'seller_name': None,
'title': 'Fiat Panda 1.2 MyLive',
'transmission': 'manual',
'trim': 'MyLive',
'year': 2011}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-29 18:44:11 [auto1.de] INFO: Saving data for LA13205: {'auction_closing_time': 1774885558.0, 'created_time': 1774522544.785169, 'last_price_update_time': 1774809851.951434}
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA13205') HTTP/1.1" 204 0
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Scrape type for NS16825: 0
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Scrape type for RN25126: 0
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Scrape type for HD52891: 2
2026-03-29 18:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-29 18:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d, identifier: HD52891
2026-03-29 18:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-29 18:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-29 18:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891 to the API
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 156,
'expiration_date': '2026-03-30T15:06:33Z',
'fuel_type': 'petrol',
'id': '2c04c2bd-a3af-503f-937e-3b7c5fafe64d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD52891',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 126447,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-06',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2020}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Saving data for HD52891: {'auction_closing_time': 1774883193.0, 'created_time': 1772542408.492189, 'last_price_update_time': 1774809852.546544}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD52891') HTTP/1.1" 204 0
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Scrape type for TA95211: 2
2026-03-29 18:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-29 18:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56cd4d27-6c7f-5503-a757-8d729027e732 with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56cd4d27-6c7f-5503-a757-8d729027e732 with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56cd4d27-6c7f-5503-a757-8d729027e732, identifier: TA95211
2026-03-29 18:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-29 18:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211
2026-03-29 18:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56cd4d27-6c7f-5503-a757-8d729027e732 with identifier: TA95211 to the API
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:28:21Z',
'fuel_type': 'petrol',
'id': '56cd4d27-6c7f-5503-a757-8d729027e732',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA95211',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 187428,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-16',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Saving data for TA95211: {'auction_closing_time': 1774884501.0, 'created_time': 1774522386.291722, 'last_price_update_time': 1774809852.956454}
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA95211') HTTP/1.1" 204 0
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-29 18:44:12 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-29 18:44:12 [auto1.de] INFO: Scrape type for JK60563: 2
2026-03-29 18:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-29 18:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7ece84-c851-5581-8502-9c5f6d8034b5 with scrape type 2
2026-03-29 18:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7ece84-c851-5581-8502-9c5f6d8034b5 with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7ece84-c851-5581-8502-9c5f6d8034b5, identifier: JK60563
2026-03-29 18:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-29 18:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-29 18:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563 to the API
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:06:58Z',
'fuel_type': 'diesel',
'id': '7f7ece84-c851-5581-8502-9c5f6d8034b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK60563',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 106259,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-06',
'seller_name': None,
'title': 'Audi A5 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2017}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Saving data for JK60563: {'auction_closing_time': 1774883218.0, 'created_time': 1773226319.30361, 'last_price_update_time': 1774809853.381425}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK60563') HTTP/1.1" 204 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for KJ44451: 2
2026-03-29 18:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-29 18:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03087a0d-cbd5-5c0f-9334-24c662e83c9f with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03087a0d-cbd5-5c0f-9334-24c662e83c9f with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03087a0d-cbd5-5c0f-9334-24c662e83c9f, identifier: KJ44451
2026-03-29 18:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-29 18:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451
2026-03-29 18:44:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03087a0d-cbd5-5c0f-9334-24c662e83c9f with identifier: KJ44451 to the API
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:26:59Z',
'fuel_type': 'diesel',
'id': '03087a0d-cbd5-5c0f-9334-24c662e83c9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ44451',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 204410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-27',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2008}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Saving data for KJ44451: {'auction_closing_time': 1774884419.0, 'created_time': 1774522220.252579, 'last_price_update_time': 1774809853.773002}
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ44451') HTTP/1.1" 204 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for UN86111: 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for CP73203: 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for GP13767: 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for YZ29676: 0
2026-03-29 18:44:13 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-29 18:44:13 [auto1.de] INFO: Scrape type for FZ80305: 2
2026-03-29 18:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-29 18:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with scrape type 2
2026-03-29 18:44:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2, identifier: FZ80305
2026-03-29 18:44:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-29 18:44:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-29 18:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305 to the API
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:47:12Z',
'fuel_type': 'petrol',
'id': 'cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ80305',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 170018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-08',
'seller_name': None,
'title': 'Seat Leon 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2013}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Saving data for FZ80305: {'auction_closing_time': 1774885632.0, 'created_time': 1773381718.379825, 'last_price_update_time': 1774809854.327761}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ80305') HTTP/1.1" 204 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ77178%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for HJ77178: 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for SX22441: 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for RU51432: 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for XR36805: 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for FH83727: 2
2026-03-29 18:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-29 18:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be3e642c-a2bf-5ae2-9bf5-274759b71517 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be3e642c-a2bf-5ae2-9bf5-274759b71517, identifier: FH83727
2026-03-29 18:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-29 18:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727
2026-03-29 18:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be3e642c-a2bf-5ae2-9bf5-274759b71517 with identifier: FH83727 to the API
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:00:14Z',
'fuel_type': 'diesel',
'id': 'be3e642c-a2bf-5ae2-9bf5-274759b71517',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH83727',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 29035,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-23',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE 4Motion',
'transmission': 'automatic',
'trim': 'IQ.DRIVE 4Motion',
'year': 2019}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Saving data for FH83727: {'auction_closing_time': 1774882814.0, 'created_time': 1774521891.880888, 'last_price_update_time': 1774809854.918323}
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH83727') HTTP/1.1" 204 0
2026-03-29 18:44:14 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for BB82459: 0
2026-03-29 18:44:14 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-29 18:44:14 [auto1.de] INFO: Scrape type for MV29238: 2
2026-03-29 18:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-29 18:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with scrape type 2
2026-03-29 18:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with scrape type 2
2026-03-29 18:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8, identifier: MV29238
2026-03-29 18:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-29 18:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-29 18:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238 to the API
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:18:31Z',
'fuel_type': 'petrol',
'id': '230e7d0c-7df9-58fe-bfd4-47e164e3c4c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV29238',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 222173,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-28',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2015}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Saving data for MV29238: {'auction_closing_time': 1774883911.0, 'created_time': 1774002542.443089, 'last_price_update_time': 1774809855.402014}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV29238') HTTP/1.1" 204 0
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Scrape type for AP93832: 0
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-29 18:44:15 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-29 18:44:15 [auto1.de] INFO: Scrape type for NA20314: 2
2026-03-29 18:44:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-29 18:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875a4a15-d927-5e75-b325-d151c808c644 with scrape type 2
2026-03-29 18:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875a4a15-d927-5e75-b325-d151c808c644 with scrape type 2
2026-03-29 18:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875a4a15-d927-5e75-b325-d151c808c644, identifier: NA20314
2026-03-29 18:44:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-29 18:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-29 18:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314 to the API
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 182,
'expiration_date': '2026-03-30T15:36:31Z',
'fuel_type': 'petrol',
'id': '875a4a15-d927-5e75-b325-d151c808c644',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA20314',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 83295,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-25',
'seller_name': None,
'title': 'Ford Fiesta 1.6 EcoBoost ST',
'transmission': 'manual',
'trim': 'ST',
'year': 2015}
2026-03-29 18:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Saving data for NA20314: {'auction_closing_time': 1774884991.0, 'created_time': 1773687381.827153, 'last_price_update_time': 1774809856.008247}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA20314') HTTP/1.1" 204 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for CG78657: 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for VC16092: 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for LF39104: 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for RD80564: 2
2026-03-29 18:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-29 18:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52902457-75bc-54d2-b7e9-8cd48c6269a0 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52902457-75bc-54d2-b7e9-8cd48c6269a0 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52902457-75bc-54d2-b7e9-8cd48c6269a0, identifier: RD80564
2026-03-29 18:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-29 18:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564
2026-03-29 18:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52902457-75bc-54d2-b7e9-8cd48c6269a0 with identifier: RD80564 to the API
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:22:41Z',
'fuel_type': 'diesel',
'id': '52902457-75bc-54d2-b7e9-8cd48c6269a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD80564',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 374134,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-14',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2012}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Saving data for RD80564: {'auction_closing_time': 1774884161.0, 'created_time': 1774521743.956604, 'last_price_update_time': 1774809856.478099}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD80564') HTTP/1.1" 204 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for TR76591: 2
2026-03-29 18:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591
2026-03-29 18:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ce736f-2978-5984-864f-c108d574507a with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ce736f-2978-5984-864f-c108d574507a with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18ce736f-2978-5984-864f-c108d574507a, identifier: TR76591
2026-03-29 18:44:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591
2026-03-29 18:44:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591
2026-03-29 18:44:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18ce736f-2978-5984-864f-c108d574507a with identifier: TR76591 to the API
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:34:57Z',
'fuel_type': 'diesel',
'id': '18ce736f-2978-5984-864f-c108d574507a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR76591',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 208959,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-30',
'seller_name': None,
'title': 'Volkswagen Touran 1.9 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Saving data for TR76591: {'auction_closing_time': 1774884897.0, 'created_time': 1774550147.750428, 'last_price_update_time': 1774809856.875036}
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR76591') HTTP/1.1" 204 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for EE47451: 0
2026-03-29 18:44:16 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY17081%27 HTTP/1.1" 200 None
2026-03-29 18:44:16 [auto1.de] INFO: Scrape type for XY17081: 2
2026-03-29 18:44:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081
2026-03-29 18:44:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29b04275-6fad-5468-9295-7900ed2ba4d9 with scrape type 2
2026-03-29 18:44:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29b04275-6fad-5468-9295-7900ed2ba4d9 with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29b04275-6fad-5468-9295-7900ed2ba4d9, identifier: XY17081
2026-03-29 18:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081
2026-03-29 18:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081
2026-03-29 18:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29b04275-6fad-5468-9295-7900ed2ba4d9 with identifier: XY17081 to the API
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:43:47Z',
'fuel_type': 'diesel',
'id': '29b04275-6fad-5468-9295-7900ed2ba4d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY17081',
'listing': 'auction',
'make': 'BMW',
'model': 'X6',
'odometer': 102209,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'BMW X6 M50d',
'transmission': 'automatic',
'trim': '',
'year': 2017}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY17081%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Saving data for XY17081: {'auction_closing_time': 1774885427.0, 'created_time': 1774002096.684097, 'last_price_update_time': 1774809857.299758}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY17081') HTTP/1.1" 204 0
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Scrape type for YP68247: 2
2026-03-29 18:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-29 18:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9b49b6-c686-54c5-aa17-30e83c44ca5c with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd9b49b6-c686-54c5-aa17-30e83c44ca5c with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd9b49b6-c686-54c5-aa17-30e83c44ca5c, identifier: YP68247
2026-03-29 18:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-29 18:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-29 18:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247 to the API
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:49:21Z',
'fuel_type': 'petrol',
'id': 'dd9b49b6-c686-54c5-aa17-30e83c44ca5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP68247',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse Limousine',
'odometer': 16621,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-19',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse Limousine A 180 Mild-Hybrid Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2023}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Saving data for YP68247: {'auction_closing_time': 1774885761.0, 'created_time': 1773401754.925079, 'last_price_update_time': 1774809857.848925}
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP68247') HTTP/1.1" 204 0
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Scrape type for BE83152: 0
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Scrape type for JM75105: 0
2026-03-29 18:44:17 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-29 18:44:17 [auto1.de] INFO: Scrape type for ZB26924: 2
2026-03-29 18:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-29 18:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 592720dc-d255-5ef9-9ad6-0d05d74c0385 with scrape type 2
2026-03-29 18:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 592720dc-d255-5ef9-9ad6-0d05d74c0385 with scrape type 2
2026-03-29 18:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 592720dc-d255-5ef9-9ad6-0d05d74c0385, identifier: ZB26924
2026-03-29 18:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-29 18:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-29 18:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924 to the API
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:28:51Z',
'fuel_type': 'diesel',
'id': '592720dc-d255-5ef9-9ad6-0d05d74c0385',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB26924',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 184222,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-01',
'seller_name': None,
'title': 'BMW X3 xDrive 30d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Saving data for ZB26924: {'auction_closing_time': 1774884531.0, 'created_time': 1773304552.381397, 'last_price_update_time': 1774809858.379457}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB26924') HTTP/1.1" 204 0
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Scrape type for GD70369: 0
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Scrape type for SZ38457: 0
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Scrape type for DG70282: 0
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Scrape type for VW39086: 0
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-29 18:44:18 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Scrape type for XV50981: 2
2026-03-29 18:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-29 18:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875fc7cd-07f1-5628-bb84-dba208d6172d with scrape type 2
2026-03-29 18:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875fc7cd-07f1-5628-bb84-dba208d6172d with scrape type 2
2026-03-29 18:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875fc7cd-07f1-5628-bb84-dba208d6172d, identifier: XV50981
2026-03-29 18:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-29 18:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-29 18:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981 to the API
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:11:22Z',
'fuel_type': 'petrol',
'id': '875fc7cd-07f1-5628-bb84-dba208d6172d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV50981',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 111249,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-26',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-29 18:44:18 [auto1.de] INFO: Saving data for XV50981: {'auction_closing_time': 1774883482.0, 'created_time': 1773688241.402181, 'last_price_update_time': 1774809858.919913}
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV50981') HTTP/1.1" 204 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for KN98252: 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for XC54847: 2
2026-03-29 18:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-29 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with scrape type 2
2026-03-29 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with scrape type 2
2026-03-29 18:44:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3, identifier: XC54847
2026-03-29 18:44:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-29 18:44:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-29 18:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847 to the API
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:34:25Z',
'fuel_type': 'petrol',
'id': '94cff63e-1ade-50c7-a6f7-6d82f95a28f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC54847',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 163517,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-21',
'seller_name': None,
'title': 'BMW 5er 523i',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Saving data for XC54847: {'auction_closing_time': 1774884865.0, 'created_time': 1773305245.493745, 'last_price_update_time': 1774809859.545113}
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC54847') HTTP/1.1" 204 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for SV32169: 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for RE30080: 0
2026-03-29 18:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:19 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for RN43410: 0
2026-03-29 18:44:19 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-29 18:44:19 [auto1.de] INFO: Scrape type for DG85302: 2
2026-03-29 18:44:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-29 18:44:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82bae6de-11ef-5a42-9e9b-934600f12292 with scrape type 2
2026-03-29 18:44:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82bae6de-11ef-5a42-9e9b-934600f12292 with scrape type 2
2026-03-29 18:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82bae6de-11ef-5a42-9e9b-934600f12292, identifier: DG85302
2026-03-29 18:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-29 18:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-29 18:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302 to the API
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:37:38Z',
'fuel_type': 'petrol',
'id': '82bae6de-11ef-5a42-9e9b-934600f12292',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG85302',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 189761,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-31',
'seller_name': None,
'title': 'Opel Zafira 1.6 Njoy mit Style-Paket',
'transmission': 'manual',
'trim': 'Njoy mit Style-Paket',
'year': 2005}
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-29 18:44:20 [auto1.de] INFO: Saving data for DG85302: {'auction_closing_time': 1774885058.0, 'created_time': 1774119106.916775, 'last_price_update_time': 1774809860.35938}
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG85302') HTTP/1.1" 204 0
2026-03-29 18:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:20 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-29 18:44:20 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-29 18:44:20 [auto1.de] INFO: Scrape type for VW61170: 0
2026-03-29 18:44:20 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-29 18:44:20 [auto1.de] INFO: Scrape type for RX47602: 0
2026-03-29 18:44:20 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-29 18:44:20 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-29 18:44:20 [auto1.de] INFO: Scrape type for FZ98450: 2
2026-03-29 18:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-29 18:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with scrape type 2
2026-03-29 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with scrape type 2
2026-03-29 18:44:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4042cea6-e7ba-5edd-a18e-4f4483c826c9, identifier: FZ98450
2026-03-29 18:44:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-29 18:44:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450
2026-03-29 18:44:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4042cea6-e7ba-5edd-a18e-4f4483c826c9 with identifier: FZ98450 to the API
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:31:07Z',
'fuel_type': 'petrol',
'id': '4042cea6-e7ba-5edd-a18e-4f4483c826c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ98450',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 103181,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-22',
'seller_name': None,
'title': 'BMW 6er 650i Gran Coupé xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2018}
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-29 18:44:20 [auto1.de] INFO: Saving data for FZ98450: {'auction_closing_time': 1774884667.0, 'created_time': 1774521799.193456, 'last_price_update_time': 1774809860.892389}
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ98450') HTTP/1.1" 204 0
2026-03-29 18:44:20 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-29 18:44:20 [auto1.de] INFO: Scrape type for TM90896: 2
2026-03-29 18:44:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-29 18:44:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with scrape type 2
2026-03-29 18:44:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with scrape type 2
2026-03-29 18:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c, identifier: TM90896
2026-03-29 18:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-29 18:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896
2026-03-29 18:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 194a6cb9-e19d-5594-9143-dc8cb05a8f4c with identifier: TM90896 to the API
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:12:46Z',
'fuel_type': 'petrol',
'id': '194a6cb9-e19d-5594-9143-dc8cb05a8f4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM90896',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 252488,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-08',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 170',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-29 18:44:21 [auto1.de] INFO: Saving data for TM90896: {'auction_closing_time': 1774883566.0, 'created_time': 1773426994.796645, 'last_price_update_time': 1774809861.357185}
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM90896') HTTP/1.1" 204 0
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-29 18:44:21 [auto1.de] INFO: Scrape type for XY25128: 0
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-29 18:44:21 [auto1.de] INFO: Scrape type for ZX93034: 0
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20802%27 HTTP/1.1" 200 None
2026-03-29 18:44:21 [auto1.de] INFO: Scrape type for XC20802: 2
2026-03-29 18:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802
2026-03-29 18:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with scrape type 2
2026-03-29 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with scrape type 2
2026-03-29 18:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9, identifier: XC20802
2026-03-29 18:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802
2026-03-29 18:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802
2026-03-29 18:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9 with identifier: XC20802 to the API
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:37:41Z',
'fuel_type': 'hybrid',
'id': '37cfcbaf-4939-5fba-b90d-2b9b4d1c17f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC20802',
'listing': 'auction',
'make': 'Toyota',
'model': 'Auris',
'odometer': 144862,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-27',
'seller_name': None,
'title': 'Toyota Auris 1.8 Hybrid START Edition',
'transmission': 'automatic',
'trim': 'START Edition',
'year': 2013}
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20802%27 HTTP/1.1" 200 None
2026-03-29 18:44:21 [auto1.de] INFO: Saving data for XC20802: {'auction_closing_time': 1774885061.0, 'created_time': 1774723251.979015, 'last_price_update_time': 1774809861.801111}
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC20802') HTTP/1.1" 204 0
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-29 18:44:21 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-29 18:44:21 [auto1.de] INFO: Scrape type for LZ76677: 2
2026-03-29 18:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-29 18:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6aec58-f7f1-5cca-8c3a-82f082984758 with scrape type 2
2026-03-29 18:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6aec58-f7f1-5cca-8c3a-82f082984758 with scrape type 2
2026-03-29 18:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d6aec58-f7f1-5cca-8c3a-82f082984758, identifier: LZ76677
2026-03-29 18:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-29 18:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677
2026-03-29 18:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d6aec58-f7f1-5cca-8c3a-82f082984758 with identifier: LZ76677 to the API
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:33Z',
'fuel_type': 'petrol',
'id': '3d6aec58-f7f1-5cca-8c3a-82f082984758',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ76677',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 55169,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-15',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2021}
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Saving data for LZ76677: {'auction_closing_time': 1774885293.0, 'created_time': 1774118537.302577, 'last_price_update_time': 1774809862.241401}
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ76677') HTTP/1.1" 204 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for XF65798: 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for TV91582: 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for YS77012: 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for CX98688: 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for VB21266: 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for AU40553: 2
2026-03-29 18:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-29 18:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9961705-a728-544e-be0f-bddba2cf9e3b with scrape type 2
2026-03-29 18:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9961705-a728-544e-be0f-bddba2cf9e3b with scrape type 2
2026-03-29 18:44:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9961705-a728-544e-be0f-bddba2cf9e3b, identifier: AU40553
2026-03-29 18:44:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-29 18:44:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-29 18:44:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553 to the API
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:25:21Z',
'fuel_type': 'diesel',
'id': 'e9961705-a728-544e-be0f-bddba2cf9e3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU40553',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Caravelle',
'odometer': 198514,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-31',
'seller_name': None,
'title': 'Volkswagen T5 Caravelle 2.0 TDI Trendline lang',
'transmission': 'manual',
'trim': 'Trendline lang',
'year': 2011}
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Saving data for AU40553: {'auction_closing_time': 1774884321.0, 'created_time': 1773686168.732536, 'last_price_update_time': 1774809862.843902}
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU40553') HTTP/1.1" 204 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for XP56939: 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-29 18:44:22 [auto1.de] INFO: Scrape type for BP72129: 0
2026-03-29 18:44:22 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-29 18:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-29 18:44:23 [auto1.de] INFO: Scrape type for JP48264: 0
2026-03-29 18:44:23 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-29 18:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:23 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:23 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-29 18:44:23 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-29 18:44:23 [auto1.de] INFO: Scrape type for BZ75769: 2
2026-03-29 18:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-29 18:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2497a8-6880-528b-a9a7-69d6d637626d with scrape type 2
2026-03-29 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f2497a8-6880-528b-a9a7-69d6d637626d with scrape type 2
2026-03-29 18:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f2497a8-6880-528b-a9a7-69d6d637626d, identifier: BZ75769
2026-03-29 18:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-29 18:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-29 18:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769 to the API
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:07Z',
'fuel_type': 'diesel',
'id': '5f2497a8-6880-528b-a9a7-69d6d637626d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ75769',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 58745,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-26',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-29 18:44:23 [auto1.de] INFO: Saving data for BZ75769: {'auction_closing_time': 1774884247.0, 'created_time': 1773135803.608433, 'last_price_update_time': 1774809863.828013}
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ75769') HTTP/1.1" 204 0
2026-03-29 18:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:23 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-29 18:44:23 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-29 18:44:23 [auto1.de] INFO: Scrape type for KG22409: 2
2026-03-29 18:44:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-29 18:44:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with scrape type 2
2026-03-29 18:44:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with scrape type 2
2026-03-29 18:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2, identifier: KG22409
2026-03-29 18:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-29 18:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-29 18:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409 to the API
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:32:52Z',
'fuel_type': 'diesel',
'id': '8c9e8a1f-2169-5a61-a85c-c33e75f596c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG22409',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 239016,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-30',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Saving data for KG22409: {'auction_closing_time': 1774884772.0, 'created_time': 1773305406.813429, 'last_price_update_time': 1774809864.336142}
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG22409') HTTP/1.1" 204 0
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Scrape type for HV92794: 0
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Scrape type for RM05292: 0
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Scrape type for GJ83963: 2
2026-03-29 18:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-29 18:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfab1721-fc06-5443-a90c-b5a9e8789030 with scrape type 2
2026-03-29 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfab1721-fc06-5443-a90c-b5a9e8789030 with scrape type 2
2026-03-29 18:44:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfab1721-fc06-5443-a90c-b5a9e8789030, identifier: GJ83963
2026-03-29 18:44:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-29 18:44:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-29 18:44:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963 to the API
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:45:57Z',
'fuel_type': 'petrol',
'id': 'cfab1721-fc06-5443-a90c-b5a9e8789030',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ83963',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 205188,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-09',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 TGDI Premium 4WD',
'transmission': 'automatic',
'trim': 'Premium 4WD',
'year': 2018}
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Saving data for GJ83963: {'auction_closing_time': 1774885557.0, 'created_time': 1774608728.563734, 'last_price_update_time': 1774809864.822834}
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ83963') HTTP/1.1" 204 0
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-29 18:44:24 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-29 18:44:24 [auto1.de] INFO: Scrape type for BP39163: 2
2026-03-29 18:44:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-29 18:44:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d229ff-9da3-5223-935e-9efaab1f9dfb with scrape type 2
2026-03-29 18:44:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01d229ff-9da3-5223-935e-9efaab1f9dfb with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01d229ff-9da3-5223-935e-9efaab1f9dfb, identifier: BP39163
2026-03-29 18:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-29 18:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-29 18:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163 to the API
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:05:58Z',
'fuel_type': 'petrol',
'id': '01d229ff-9da3-5223-935e-9efaab1f9dfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP39163',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 69580,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-17',
'seller_name': None,
'title': 'Land Rover Discovery Sport P200 Mild-Hybrid S AWD',
'transmission': 'automatic',
'trim': 'S AWD',
'year': 2020}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Saving data for BP39163: {'auction_closing_time': 1774883158.0, 'created_time': 1773687721.834316, 'last_price_update_time': 1774809865.384006}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP39163') HTTP/1.1" 204 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for YV66765: 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for RT17633: 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for ZW99084: 2
2026-03-29 18:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-29 18:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b, identifier: ZW99084
2026-03-29 18:44:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-29 18:44:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-29 18:44:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084 to the API
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:57:39Z',
'fuel_type': 'diesel',
'id': 'd1cb2c7a-2cf2-5d04-9bb0-faa016272f2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW99084',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 195256,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-02',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Saving data for ZW99084: {'auction_closing_time': 1774886259.0, 'created_time': 1774034285.469778, 'last_price_update_time': 1774809865.886256}
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW99084') HTTP/1.1" 204 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for JH89792: 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for ZT23330: 0
2026-03-29 18:44:25 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-29 18:44:25 [auto1.de] INFO: Scrape type for NY57954: 2
2026-03-29 18:44:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-29 18:44:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b575ab56-4e40-5e82-a411-f0b973127896 with scrape type 2
2026-03-29 18:44:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b575ab56-4e40-5e82-a411-f0b973127896 with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b575ab56-4e40-5e82-a411-f0b973127896, identifier: NY57954
2026-03-29 18:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-29 18:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954
2026-03-29 18:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b575ab56-4e40-5e82-a411-f0b973127896 with identifier: NY57954 to the API
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:11Z',
'fuel_type': 'diesel',
'id': 'b575ab56-4e40-5e82-a411-f0b973127896',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY57954',
'listing': 'auction',
'make': 'Chrysler',
'model': 'Grand Voyager',
'odometer': 255384,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-26',
'seller_name': None,
'title': 'Chrysler Grand Voyager 2.8 CRD Limited',
'transmission': 'automatic',
'trim': 'Limited',
'year': 2006}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Saving data for NY57954: {'auction_closing_time': 1774884851.0, 'created_time': 1774521566.263937, 'last_price_update_time': 1774809866.325354}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY57954') HTTP/1.1" 204 0
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Scrape type for MZ83474: 0
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Scrape type for PA30689: 2
2026-03-29 18:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-29 18:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b759d130-765d-505a-8a0b-7214f4dc3273 with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b759d130-765d-505a-8a0b-7214f4dc3273 with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b759d130-765d-505a-8a0b-7214f4dc3273, identifier: PA30689
2026-03-29 18:44:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-29 18:44:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-29 18:44:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689 to the API
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:34Z',
'fuel_type': 'diesel',
'id': 'b759d130-765d-505a-8a0b-7214f4dc3273',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA30689',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 176638,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-02',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2013}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Saving data for PA30689: {'auction_closing_time': 1774883374.0, 'created_time': 1774294385.743561, 'last_price_update_time': 1774809866.774527}
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA30689') HTTP/1.1" 204 0
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-29 18:44:26 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-29 18:44:26 [auto1.de] INFO: Scrape type for BR02529: 2
2026-03-29 18:44:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-29 18:44:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 919a610f-0423-5d5d-88ba-e207de3af9ba with scrape type 2
2026-03-29 18:44:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 919a610f-0423-5d5d-88ba-e207de3af9ba with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 919a610f-0423-5d5d-88ba-e207de3af9ba, identifier: BR02529
2026-03-29 18:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-29 18:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529
2026-03-29 18:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 919a610f-0423-5d5d-88ba-e207de3af9ba with identifier: BR02529 to the API
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:10:06Z',
'fuel_type': 'diesel',
'id': '919a610f-0423-5d5d-88ba-e207de3af9ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR02529',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 198985,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-25',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'manual',
'trim': 'RS',
'year': 2015}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Saving data for BR02529: {'auction_closing_time': 1774883406.0, 'created_time': 1773428791.887474, 'last_price_update_time': 1774809867.289825}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR02529') HTTP/1.1" 204 0
2026-03-29 18:44:27 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-29 18:44:27 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-29 18:44:27 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-29 18:44:27 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA03321%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Scrape type for UA03321: 2
2026-03-29 18:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321
2026-03-29 18:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1876c610-1c04-5f56-a37d-841774f85032 with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1876c610-1c04-5f56-a37d-841774f85032 with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1876c610-1c04-5f56-a37d-841774f85032, identifier: UA03321
2026-03-29 18:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321
2026-03-29 18:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321
2026-03-29 18:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1876c610-1c04-5f56-a37d-841774f85032 with identifier: UA03321 to the API
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:56:03Z',
'fuel_type': 'diesel',
'id': '1876c610-1c04-5f56-a37d-841774f85032',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA03321',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 127630,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-03',
'seller_name': None,
'title': 'Audi A3 Limousine 1.6 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2018}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA03321%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Saving data for UA03321: {'auction_closing_time': 1774886163.0, 'created_time': 1774031993.3809, 'last_price_update_time': 1774809867.675173}
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA03321') HTTP/1.1" 204 0
2026-03-29 18:44:27 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-29 18:44:27 [auto1.de] INFO: Scrape type for PG58570: 2
2026-03-29 18:44:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-29 18:44:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d38fb5a-07dd-5f2b-87a1-649695015f5e with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d38fb5a-07dd-5f2b-87a1-649695015f5e with scrape type 2
2026-03-29 18:44:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d38fb5a-07dd-5f2b-87a1-649695015f5e, identifier: PG58570
2026-03-29 18:44:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-29 18:44:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570
2026-03-29 18:44:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d38fb5a-07dd-5f2b-87a1-649695015f5e with identifier: PG58570 to the API
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:55:56Z',
'fuel_type': 'diesel',
'id': '7d38fb5a-07dd-5f2b-87a1-649695015f5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG58570',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 150140,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-18',
'seller_name': None,
'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Saving data for PG58570: {'auction_closing_time': 1774886156.0, 'created_time': 1774522473.570053, 'last_price_update_time': 1774809868.084082}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG58570') HTTP/1.1" 204 0
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Scrape type for BR69139: 2
2026-03-29 18:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-29 18:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60eda562-9dc3-5285-9e14-2312e2ea5c86 with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60eda562-9dc3-5285-9e14-2312e2ea5c86 with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60eda562-9dc3-5285-9e14-2312e2ea5c86, identifier: BR69139
2026-03-29 18:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-29 18:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-29 18:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139 to the API
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:47:36Z',
'fuel_type': 'petrol',
'id': '60eda562-9dc3-5285-9e14-2312e2ea5c86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR69139',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 123085,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-27',
'seller_name': None,
'title': 'BMW 2er 220i Active Tourer Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Saving data for BR69139: {'auction_closing_time': 1774885656.0, 'created_time': 1774608354.263438, 'last_price_update_time': 1774809868.526024}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR69139') HTTP/1.1" 204 0
2026-03-29 18:44:28 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Scrape type for CE50485: 0
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-29 18:44:28 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Scrape type for SM20101: 2
2026-03-29 18:44:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-29 18:44:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f0ebb0-c754-579c-811c-465a65648709 with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27f0ebb0-c754-579c-811c-465a65648709 with scrape type 2
2026-03-29 18:44:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27f0ebb0-c754-579c-811c-465a65648709, identifier: SM20101
2026-03-29 18:44:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-29 18:44:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-29 18:44:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101 to the API
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:37:23Z',
'fuel_type': 'diesel',
'id': '27f0ebb0-c754-579c-811c-465a65648709',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM20101',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 170810,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-26',
'seller_name': None,
'title': 'MINI Cooper D',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-29 18:44:28 [auto1.de] INFO: Saving data for SM20101: {'auction_closing_time': 1774885043.0, 'created_time': 1774608238.367077, 'last_price_update_time': 1774809868.985959}
2026-03-29 18:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM20101') HTTP/1.1" 204 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for ST81436: 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for SA71883: 2
2026-03-29 18:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-29 18:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b, identifier: SA71883
2026-03-29 18:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for ZE45367: 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for AF24484: 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for GD52714: 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-29 18:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-29 18:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-29 18:44:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883 to the API
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:12:52Z',
'fuel_type': 'petrol',
'id': '3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA71883',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 123196,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2016}
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Saving data for SA71883: {'auction_closing_time': 1774883572.0, 'created_time': 1773307123.653284, 'last_price_update_time': 1774809869.625546}
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA71883') HTTP/1.1" 204 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for ED78349: 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for RT49707: 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for KG76209: 0
2026-03-29 18:44:29 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-29 18:44:29 [auto1.de] INFO: Scrape type for RC79950: 2
2026-03-29 18:44:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-29 18:44:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with scrape type 2
2026-03-29 18:44:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05fbefd-eebc-541e-8bfc-188e30d0f7a7, identifier: RC79950
2026-03-29 18:44:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-29 18:44:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-29 18:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950 to the API
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:33:03Z',
'fuel_type': 'petrol',
'id': 'd05fbefd-eebc-541e-8bfc-188e30d0f7a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC79950',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 141717,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-18',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Match',
'transmission': 'automatic',
'trim': 'Match',
'year': 2012}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Saving data for RC79950: {'auction_closing_time': 1774884783.0, 'created_time': 1774608074.248467, 'last_price_update_time': 1774809870.230759}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC79950') HTTP/1.1" 204 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for BC36387: 2
2026-03-29 18:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-29 18:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19bd8017-e7b4-51a2-9694-36cb39d848fd with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19bd8017-e7b4-51a2-9694-36cb39d848fd with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19bd8017-e7b4-51a2-9694-36cb39d848fd, identifier: BC36387
2026-03-29 18:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-29 18:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-29 18:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387 to the API
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:38:16Z',
'fuel_type': 'petrol',
'id': '19bd8017-e7b4-51a2-9694-36cb39d848fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC36387',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 120942,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-23',
'seller_name': None,
'title': 'BMW 3er 318i',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Saving data for BC36387: {'auction_closing_time': 1774885096.0, 'created_time': 1773859125.080912, 'last_price_update_time': 1774809870.683268}
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC36387') HTTP/1.1" 204 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for YK39735: 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for YF85970: 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for LZ35604: 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for SA20211: 0
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-29 18:44:30 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-29 18:44:30 [auto1.de] INFO: Scrape type for NU80618: 2
2026-03-29 18:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618
2026-03-29 18:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694a5e0e-e8ac-5370-877c-42471d4b3060 with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694a5e0e-e8ac-5370-877c-42471d4b3060 with scrape type 2
2026-03-29 18:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 694a5e0e-e8ac-5370-877c-42471d4b3060, identifier: NU80618
2026-03-29 18:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618
2026-03-29 18:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618
2026-03-29 18:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618 to the API
2026-03-29 18:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:31:27Z',
'fuel_type': 'petrol',
'id': '694a5e0e-e8ac-5370-877c-42471d4b3060',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU80618',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 201154,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-17',
'seller_name': None,
'title': 'Audi A3 Sportback 1.8 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2009}
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-29 18:44:31 [auto1.de] INFO: Saving data for NU80618: {'auction_closing_time': 1774884687.0, 'created_time': 1774510535.567979, 'last_price_update_time': 1774809871.446099}
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU80618') HTTP/1.1" 204 0
2026-03-29 18:44:31 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-29 18:44:31 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-29 18:44:31 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-29 18:44:31 [auto1.de] INFO: Scrape type for AX34994: 2
2026-03-29 18:44:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-29 18:44:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41989d1-c454-55c8-a89f-5beb9c4d5963 with scrape type 2
2026-03-29 18:44:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41989d1-c454-55c8-a89f-5beb9c4d5963 with scrape type 2
2026-03-29 18:44:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d41989d1-c454-55c8-a89f-5beb9c4d5963, identifier: AX34994
2026-03-29 18:44:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-29 18:44:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-29 18:44:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994 to the API
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:54:35Z',
'fuel_type': 'diesel',
'id': 'd41989d1-c454-55c8-a89f-5beb9c4d5963',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX34994',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 114962,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-19',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2017}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Saving data for AX34994: {'auction_closing_time': 1774886075.0, 'created_time': 1773382439.492193, 'last_price_update_time': 1774809872.038934}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX34994') HTTP/1.1" 204 0
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Scrape type for KL53394: 2
2026-03-29 18:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394
2026-03-29 18:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5cffa74-f5b0-5ff0-b50f-c93219cffd91, identifier: KL53394
2026-03-29 18:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394
2026-03-29 18:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394
2026-03-29 18:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5cffa74-f5b0-5ff0-b50f-c93219cffd91 with identifier: KL53394 to the API
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:42:18Z',
'fuel_type': 'diesel',
'id': 'f5cffa74-f5b0-5ff0-b50f-c93219cffd91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53394',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 154104,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-23',
'seller_name': None,
'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
'transmission': 'automatic',
'trim': 'Sports-Line',
'year': 2015}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Saving data for KL53394: {'auction_closing_time': 1774885338.0, 'created_time': 1774636597.45185, 'last_price_update_time': 1774809872.442499}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL53394') HTTP/1.1" 204 0
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Scrape type for GA20411: 2
2026-03-29 18:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-29 18:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46284532-db18-5b34-8a18-4bdf04d8994b with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46284532-db18-5b34-8a18-4bdf04d8994b with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46284532-db18-5b34-8a18-4bdf04d8994b, identifier: GA20411
2026-03-29 18:44:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-29 18:44:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-29 18:44:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411 to the API
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:54:27Z',
'fuel_type': 'diesel',
'id': '46284532-db18-5b34-8a18-4bdf04d8994b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA20411',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XF',
'odometer': 120718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'Jaguar XF 30d S',
'transmission': 'automatic',
'trim': 'S',
'year': 2018}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Saving data for GA20411: {'auction_closing_time': 1774886067.0, 'created_time': 1773344437.804729, 'last_price_update_time': 1774809872.915839}
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA20411') HTTP/1.1" 204 0
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-29 18:44:32 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-29 18:44:32 [auto1.de] INFO: Scrape type for DV57223: 2
2026-03-29 18:44:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223
2026-03-29 18:44:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648cddcb-d621-5a04-8fc3-97ae185f5699 with scrape type 2
2026-03-29 18:44:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648cddcb-d621-5a04-8fc3-97ae185f5699 with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 648cddcb-d621-5a04-8fc3-97ae185f5699, identifier: DV57223
2026-03-29 18:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223
2026-03-29 18:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223
2026-03-29 18:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 648cddcb-d621-5a04-8fc3-97ae185f5699 with identifier: DV57223 to the API
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 83,
'expiration_date': '2026-03-30T15:28:59Z',
'fuel_type': 'petrol',
'id': '648cddcb-d621-5a04-8fc3-97ae185f5699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV57223',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 3150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-10-05',
'seller_name': None,
'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Comfort+',
'transmission': 'automatic',
'trim': 'Comfort+',
'year': 2025}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Saving data for DV57223: {'auction_closing_time': 1774884539.0, 'created_time': 1774636650.92445, 'last_price_update_time': 1774809873.313668}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV57223') HTTP/1.1" 204 0
2026-03-29 18:44:33 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Scrape type for UH91436: 2
2026-03-29 18:44:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-29 18:44:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d39a44-8562-54af-b1e6-acda3330eaed with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d39a44-8562-54af-b1e6-acda3330eaed with scrape type 2
2026-03-29 18:44:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83d39a44-8562-54af-b1e6-acda3330eaed, identifier: UH91436
2026-03-29 18:44:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-29 18:44:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-29 18:44:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436 to the API
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:02:34Z',
'fuel_type': 'hybrid',
'id': '83d39a44-8562-54af-b1e6-acda3330eaed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH91436',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 91304,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-21',
'seller_name': None,
'title': 'Audi Q3 Sportback 45 TFSIe',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-29 18:44:33 [auto1.de] INFO: Saving data for UH91436: {'auction_closing_time': 1774882954.0, 'created_time': 1773772567.508528, 'last_price_update_time': 1774809873.951203}
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH91436') HTTP/1.1" 204 0
2026-03-29 18:44:34 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-29 18:44:34 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-29 18:44:34 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-29 18:44:34 [auto1.de] INFO: Scrape type for JV29717: 2
2026-03-29 18:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-29 18:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cbefa3-116c-527d-bd73-7fd02a8ea455 with scrape type 2
2026-03-29 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37cbefa3-116c-527d-bd73-7fd02a8ea455 with scrape type 2
2026-03-29 18:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37cbefa3-116c-527d-bd73-7fd02a8ea455, identifier: JV29717
2026-03-29 18:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-29 18:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-29 18:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717 to the API
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:37:42Z',
'fuel_type': 'diesel',
'id': '37cbefa3-116c-527d-bd73-7fd02a8ea455',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV29717',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 191465,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-12-21',
'seller_name': None,
'title': 'BMW X3 3.0d',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-29 18:44:34 [auto1.de] INFO: Saving data for JV29717: {'auction_closing_time': 1774885062.0, 'created_time': 1774608510.180632, 'last_price_update_time': 1774809874.551896}
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV29717') HTTP/1.1" 204 0
2026-03-29 18:44:34 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-29 18:44:34 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-29 18:44:34 [auto1.de] INFO: Scrape type for YL01247: 0
2026-03-29 18:44:34 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-29 18:44:34 [auto1.de] INFO: Scrape type for XT97786: 2
2026-03-29 18:44:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-29 18:44:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6facd69-7e21-50c3-9f3f-9f041ea4f94b with scrape type 2
2026-03-29 18:44:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6facd69-7e21-50c3-9f3f-9f041ea4f94b with scrape type 2
2026-03-29 18:44:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6facd69-7e21-50c3-9f3f-9f041ea4f94b, identifier: XT97786
2026-03-29 18:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-29 18:44:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-29 18:44:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786 to the API
2026-03-29 18:44:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:18:11Z',
'fuel_type': 'diesel',
'id': 'b6facd69-7e21-50c3-9f3f-9f041ea4f94b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT97786',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 161110,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-04',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Saving data for XT97786: {'auction_closing_time': 1774883891.0, 'created_time': 1773304551.431809, 'last_price_update_time': 1774809875.148693}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT97786') HTTP/1.1" 204 0
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-29 18:44:35 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Scrape type for PL91584: 0
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Scrape type for PP77608: 0
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Scrape type for BS79013: 0
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Scrape type for DB13775: 2
2026-03-29 18:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775
2026-03-29 18:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4db90cd0-bd81-5dbe-a86e-5b164b16d036, identifier: DB13775
2026-03-29 18:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775
2026-03-29 18:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775
2026-03-29 18:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4db90cd0-bd81-5dbe-a86e-5b164b16d036 with identifier: DB13775 to the API
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:34:22Z',
'fuel_type': 'diesel',
'id': '4db90cd0-bd81-5dbe-a86e-5b164b16d036',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB13775',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 166388,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-07',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2015}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Saving data for DB13775: {'auction_closing_time': 1774884862.0, 'created_time': 1774636541.437442, 'last_price_update_time': 1774809875.610724}
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB13775') HTTP/1.1" 204 0
2026-03-29 18:44:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:35 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-29 18:44:35 [auto1.de] INFO: Scrape type for CR52623: 2
2026-03-29 18:44:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-29 18:44:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf909b0-c479-565e-b019-828c74c2efe9 with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf909b0-c479-565e-b019-828c74c2efe9 with scrape type 2
2026-03-29 18:44:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf909b0-c479-565e-b019-828c74c2efe9, identifier: CR52623
2026-03-29 18:44:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-29 18:44:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-29 18:44:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623 to the API
2026-03-29 18:44:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:12:02Z',
'fuel_type': 'diesel',
'id': 'faf909b0-c479-565e-b019-828c74c2efe9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR52623',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 199818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-13',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi FT 280 K',
'transmission': 'manual',
'trim': 'FT 280 K',
'year': 2009}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Saving data for CR52623: {'auction_closing_time': 1774883522.0, 'created_time': 1773402579.945902, 'last_price_update_time': 1774809876.199298}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR52623') HTTP/1.1" 204 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for LZ21667: 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for SJ57500: 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for CU14126: 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for SP90277: 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for KS04135: 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for VX06445: 2
2026-03-29 18:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-29 18:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08dc822-4b4c-5c84-b321-2e726280e311 with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08dc822-4b4c-5c84-b321-2e726280e311 with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08dc822-4b4c-5c84-b321-2e726280e311, identifier: VX06445
2026-03-29 18:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-29 18:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445
2026-03-29 18:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08dc822-4b4c-5c84-b321-2e726280e311 with identifier: VX06445 to the API
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:13:47Z',
'fuel_type': 'hybrid',
'id': 'f08dc822-4b4c-5c84-b321-2e726280e311',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX06445',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse Limousine',
'odometer': 55456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse Limousine A 250e AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Saving data for VX06445: {'auction_closing_time': 1774883627.0, 'created_time': 1773382805.309694, 'last_price_update_time': 1774809876.785896}
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX06445') HTTP/1.1" 204 0
2026-03-29 18:44:36 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-29 18:44:36 [auto1.de] INFO: Scrape type for BD42318: 2
2026-03-29 18:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-29 18:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with scrape type 2
2026-03-29 18:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875, identifier: BD42318
2026-03-29 18:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-29 18:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-29 18:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318 to the API
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:29:29Z',
'fuel_type': 'diesel',
'id': 'fc54d6a4-0fb1-5961-bd3c-16f3cb81a875',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD42318',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 237268,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-13',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 d T 4Matic AMG Line',
'transmission': 'automatic',
'trim': 'T 4Matic AMG Line',
'year': 2018}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Saving data for BD42318: {'auction_closing_time': 1774884569.0, 'created_time': 1773228097.361381, 'last_price_update_time': 1774809877.362086}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD42318') HTTP/1.1" 204 0
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Scrape type for RH48062: 0
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Scrape type for CV42130: 0
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Scrape type for ZY94421: 2
2026-03-29 18:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-29 18:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a5ece7-0122-5032-98d5-9adef530e5cb with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5a5ece7-0122-5032-98d5-9adef530e5cb with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5a5ece7-0122-5032-98d5-9adef530e5cb, identifier: ZY94421
2026-03-29 18:44:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-29 18:44:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421
2026-03-29 18:44:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5a5ece7-0122-5032-98d5-9adef530e5cb with identifier: ZY94421 to the API
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:53:24Z',
'fuel_type': 'petrol',
'id': 'b5a5ece7-0122-5032-98d5-9adef530e5cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY94421',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 156391,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-17',
'seller_name': None,
'title': 'BMW 1er 118i',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Saving data for ZY94421: {'auction_closing_time': 1774886004.0, 'created_time': 1774521362.880234, 'last_price_update_time': 1774809877.810431}
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY94421') HTTP/1.1" 204 0
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Scrape type for VE85293: 0
2026-03-29 18:44:37 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-29 18:44:37 [auto1.de] INFO: Scrape type for BU63404: 2
2026-03-29 18:44:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-29 18:44:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f9a921-65a4-5460-b3b7-5b841dd57e39 with scrape type 2
2026-03-29 18:44:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f9a921-65a4-5460-b3b7-5b841dd57e39 with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f9a921-65a4-5460-b3b7-5b841dd57e39, identifier: BU63404
2026-03-29 18:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-29 18:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-29 18:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404 to the API
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:47Z',
'fuel_type': 'diesel',
'id': 'c7f9a921-65a4-5460-b3b7-5b841dd57e39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU63404',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 59284,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-29',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Saving data for BU63404: {'auction_closing_time': 1774884707.0, 'created_time': 1773380713.034147, 'last_price_update_time': 1774809878.341244}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU63404') HTTP/1.1" 204 0
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Scrape type for FW07623: 2
2026-03-29 18:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-29 18:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adbab63c-2a58-583f-a690-7f2a4289dbc7 with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adbab63c-2a58-583f-a690-7f2a4289dbc7 with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adbab63c-2a58-583f-a690-7f2a4289dbc7, identifier: FW07623
2026-03-29 18:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-29 18:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623
2026-03-29 18:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adbab63c-2a58-583f-a690-7f2a4289dbc7 with identifier: FW07623 to the API
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:52Z',
'fuel_type': 'petrol',
'id': 'adbab63c-2a58-583f-a690-7f2a4289dbc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW07623',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 31105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-07',
'seller_name': None,
'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2019}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Saving data for FW07623: {'auction_closing_time': 1774886092.0, 'created_time': 1774521681.480761, 'last_price_update_time': 1774809878.73128}
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW07623') HTTP/1.1" 204 0
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Scrape type for HT41484: 0
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Scrape type for FS23827: 0
2026-03-29 18:44:38 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-29 18:44:38 [auto1.de] INFO: Scrape type for XS31792: 2
2026-03-29 18:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-29 18:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with scrape type 2
2026-03-29 18:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a, identifier: XS31792
2026-03-29 18:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-29 18:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-29 18:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792 to the API
2026-03-29 18:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:56:35Z',
'fuel_type': 'petrol',
'id': '8a302eb6-04ad-5d88-9cef-63b3bda3f28a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS31792',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 120214,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-10',
'seller_name': None,
'title': 'Audi A6 45 TFSI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Saving data for XS31792: {'auction_closing_time': 1774886195.0, 'created_time': 1773303155.605887, 'last_price_update_time': 1774809879.276781}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS31792') HTTP/1.1" 204 0
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-29 18:44:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:39 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for TP43988: 0
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for DZ95000: 0
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for TS65125: 2
2026-03-29 18:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-29 18:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with scrape type 2
2026-03-29 18:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with scrape type 2
2026-03-29 18:44:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38a44cc-2c4b-55de-8fda-14cd9a5721e1, identifier: TS65125
2026-03-29 18:44:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-29 18:44:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125
2026-03-29 18:44:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38a44cc-2c4b-55de-8fda-14cd9a5721e1 with identifier: TS65125 to the API
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 250,
'expiration_date': '2026-03-30T15:30:56Z',
'fuel_type': 'petrol',
'id': 'f38a44cc-2c4b-55de-8fda-14cd9a5721e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS65125',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 35585,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-03',
'seller_name': None,
'title': 'Volvo XC60 2.0 T5 Momentum 2WD',
'transmission': 'automatic',
'trim': 'Momentum 2WD',
'year': 2018}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Saving data for TS65125: {'auction_closing_time': 1774884656.0, 'created_time': 1773946815.264712, 'last_price_update_time': 1774809879.940111}
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS65125') HTTP/1.1" 204 0
2026-03-29 18:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for ZV59345: 0
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-29 18:44:39 [auto1.de] INFO: Scrape type for MH02928: 0
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-29 18:44:39 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Scrape type for XT54020: 0
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Scrape type for WR03810: 2
2026-03-29 18:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-29 18:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9f5d2dd-41f6-51fe-9541-1e1f00d44311, identifier: WR03810
2026-03-29 18:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-29 18:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-29 18:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810 to the API
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:39:11Z',
'fuel_type': 'diesel',
'id': 'b9f5d2dd-41f6-51fe-9541-1e1f00d44311',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR03810',
'listing': 'auction',
'make': 'Renault',
'model': 'Express',
'odometer': 94309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-23',
'seller_name': None,
'title': 'Renault Express 1.5 BLUE dCi Extra',
'transmission': 'manual',
'trim': 'Extra',
'year': 2022}
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Saving data for WR03810: {'auction_closing_time': 1774885151.0, 'created_time': 1774607840.606156, 'last_price_update_time': 1774809880.449599}
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR03810') HTTP/1.1" 204 0
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Scrape type for CS21396: 0
2026-03-29 18:44:40 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-29 18:44:40 [auto1.de] INFO: Scrape type for HA98136: 2
2026-03-29 18:44:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-29 18:44:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with scrape type 2
2026-03-29 18:44:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017, identifier: HA98136
2026-03-29 18:44:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-29 18:44:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-29 18:44:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136 to the API
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:31:39Z',
'fuel_type': 'diesel',
'id': '02ed9ec5-b2fe-5d1f-be32-8b653bbed017',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA98136',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 168235,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-29',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2013}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Saving data for HA98136: {'auction_closing_time': 1774884699.0, 'created_time': 1774294619.554806, 'last_price_update_time': 1774809881.009353}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA98136') HTTP/1.1" 204 0
2026-03-29 18:44:41 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-29 18:44:41 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Scrape type for XX95177: 0
2026-03-29 18:44:41 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-29 18:44:41 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Scrape type for KA91193: 2
2026-03-29 18:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193
2026-03-29 18:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0dcf67e-be73-592d-9d23-ecb90c3f4733 with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0dcf67e-be73-592d-9d23-ecb90c3f4733 with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0dcf67e-be73-592d-9d23-ecb90c3f4733, identifier: KA91193
2026-03-29 18:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193
2026-03-29 18:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193
2026-03-29 18:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0dcf67e-be73-592d-9d23-ecb90c3f4733 with identifier: KA91193 to the API
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:08:08Z',
'fuel_type': 'diesel',
'id': 'a0dcf67e-be73-592d-9d23-ecb90c3f4733',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA91193',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 144659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-08',
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Design',
'transmission': 'automatic',
'trim': 'quattro Design',
'year': 2019}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Saving data for KA91193: {'auction_closing_time': 1774883288.0, 'created_time': 1774350504.235086, 'last_price_update_time': 1774809881.562054}
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA91193') HTTP/1.1" 204 0
2026-03-29 18:44:41 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-29 18:44:41 [auto1.de] INFO: Scrape type for CF22867: 2
2026-03-29 18:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867
2026-03-29 18:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1190f770-ee47-50b4-a859-a2ccb1323105 with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1190f770-ee47-50b4-a859-a2ccb1323105 with scrape type 2
2026-03-29 18:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1190f770-ee47-50b4-a859-a2ccb1323105, identifier: CF22867
2026-03-29 18:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867
2026-03-29 18:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867
2026-03-29 18:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1190f770-ee47-50b4-a859-a2ccb1323105 with identifier: CF22867 to the API
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 335,
'expiration_date': '2026-03-30T15:10:20Z',
'fuel_type': 'petrol',
'id': '1190f770-ee47-50b4-a859-a2ccb1323105',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF22867',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Phaeton',
'odometer': 142589,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-30',
'seller_name': None,
'title': 'Volkswagen Phaeton 4.2 V8 Lang 4Motion',
'transmission': 'automatic',
'trim': 'Lang 4Motion',
'year': 2016}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Saving data for CF22867: {'auction_closing_time': 1774883420.0, 'created_time': 1774550156.804689, 'last_price_update_time': 1774809882.015022}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF22867') HTTP/1.1" 204 0
2026-03-29 18:44:42 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-29 18:44:42 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-29 18:44:42 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Scrape type for UH14154: 2
2026-03-29 18:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-29 18:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1, identifier: UH14154
2026-03-29 18:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-29 18:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-29 18:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154 to the API
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:54:29Z',
'fuel_type': 'diesel',
'id': '28da6de1-f323-539f-9b1f-4f6a5cd5bfe1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14154',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 330018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-31',
'seller_name': None,
'title': 'Opel Zafira 1.7 CDTI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Saving data for UH14154: {'auction_closing_time': 1774886069.0, 'created_time': 1774291482.065451, 'last_price_update_time': 1774809882.459863}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH14154') HTTP/1.1" 204 0
2026-03-29 18:44:42 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-29 18:44:42 [auto1.de] INFO: Scrape type for MB08927: 2
2026-03-29 18:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-29 18:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4202ac89-9b17-5be0-ba22-a104919c1920 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4202ac89-9b17-5be0-ba22-a104919c1920 with scrape type 2
2026-03-29 18:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4202ac89-9b17-5be0-ba22-a104919c1920, identifier: MB08927
2026-03-29 18:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-29 18:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927
2026-03-29 18:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4202ac89-9b17-5be0-ba22-a104919c1920 with identifier: MB08927 to the API
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:30:03Z',
'fuel_type': 'diesel',
'id': '4202ac89-9b17-5be0-ba22-a104919c1920',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB08927',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 127535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-29 18:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Saving data for MB08927: {'auction_closing_time': 1774884603.0, 'created_time': 1774522166.613032, 'last_price_update_time': 1774809883.005606}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB08927') HTTP/1.1" 204 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for NN79660: 2
2026-03-29 18:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-29 18:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d, identifier: NN79660
2026-03-29 18:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-29 18:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-29 18:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660 to the API
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:13:04Z',
'fuel_type': 'diesel',
'id': '5ab8c9ee-88fa-56a1-bfe5-5139cebf843d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN79660',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 581,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-12-15',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 317 CDI Kasten L2',
'transmission': 'automatic',
'trim': 'Kasten L2',
'year': 2025}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Saving data for NN79660: {'auction_closing_time': 1774883584.0, 'created_time': 1773304162.915518, 'last_price_update_time': 1774809883.450811}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN79660') HTTP/1.1" 204 0
2026-03-29 18:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for FB02409: 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for FK58652: 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for XJ83535: 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU13367%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for AU13367: 2
2026-03-29 18:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367
2026-03-29 18:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9431b620-6665-59b9-97aa-c9ef63fcb218 with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9431b620-6665-59b9-97aa-c9ef63fcb218 with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9431b620-6665-59b9-97aa-c9ef63fcb218, identifier: AU13367
2026-03-29 18:44:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367
2026-03-29 18:44:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367
2026-03-29 18:44:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9431b620-6665-59b9-97aa-c9ef63fcb218 with identifier: AU13367 to the API
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:57Z',
'fuel_type': 'petrol',
'id': '9431b620-6665-59b9-97aa-c9ef63fcb218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU13367',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Limousine',
'odometer': 72652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seller_name': None,
'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU13367%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Saving data for AU13367: {'auction_closing_time': 1774885377.0, 'created_time': 1774034343.407002, 'last_price_update_time': 1774809883.909312}
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU13367') HTTP/1.1" 204 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for HS09512: 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for RV14336: 0
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-29 18:44:43 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-29 18:44:43 [auto1.de] INFO: Scrape type for YZ03964: 2
2026-03-29 18:44:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-29 18:44:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 556411f9-e0ae-5b77-b203-76680d81cadf with scrape type 2
2026-03-29 18:44:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 556411f9-e0ae-5b77-b203-76680d81cadf with scrape type 2
2026-03-29 18:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 556411f9-e0ae-5b77-b203-76680d81cadf, identifier: YZ03964
2026-03-29 18:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-29 18:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964
2026-03-29 18:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 556411f9-e0ae-5b77-b203-76680d81cadf with identifier: YZ03964 to the API
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:15:16Z',
'fuel_type': 'diesel',
'id': '556411f9-e0ae-5b77-b203-76680d81cadf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ03964',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Multivan',
'odometer': 185890,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-11',
'seller_name': None,
'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2017}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-29 18:44:44 [auto1.de] INFO: Saving data for YZ03964: {'auction_closing_time': 1774883716.0, 'created_time': 1774522430.192459, 'last_price_update_time': 1774809884.389113}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ03964') HTTP/1.1" 204 0
2026-03-29 18:44:44 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:44 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-29 18:44:44 [auto1.de] INFO: Scrape type for TB33384: 2
2026-03-29 18:44:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-29 18:44:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7693f19-c320-5040-bb7b-fb5236ae8153 with scrape type 2
2026-03-29 18:44:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7693f19-c320-5040-bb7b-fb5236ae8153 with scrape type 2
2026-03-29 18:44:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7693f19-c320-5040-bb7b-fb5236ae8153, identifier: TB33384
2026-03-29 18:44:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-29 18:44:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-29 18:44:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384 to the API
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 201,
'expiration_date': '2026-03-30T15:15:29Z',
'fuel_type': 'diesel',
'id': 'b7693f19-c320-5040-bb7b-fb5236ae8153',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB33384',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 84430,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-11',
'seller_name': None,
'title': 'BMW 5er 520d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2019}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-29 18:44:44 [auto1.de] INFO: Saving data for TB33384: {'auction_closing_time': 1774883729.0, 'created_time': 1773307184.877723, 'last_price_update_time': 1774809884.972197}
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB33384') HTTP/1.1" 204 0
2026-03-29 18:44:44 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-29 18:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for GY64031: 0
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for BM71162: 0
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for KS78216: 2
2026-03-29 18:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-29 18:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4bf374e-3d58-5714-8290-da8e35fc7eab with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4bf374e-3d58-5714-8290-da8e35fc7eab with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4bf374e-3d58-5714-8290-da8e35fc7eab, identifier: KS78216
2026-03-29 18:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-29 18:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-29 18:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216 to the API
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:46:14Z',
'fuel_type': 'petrol',
'id': 'd4bf374e-3d58-5714-8290-da8e35fc7eab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS78216',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 87652,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-23',
'seller_name': None,
'title': 'Suzuki Jimny 1.3 Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2006}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Saving data for KS78216: {'auction_closing_time': 1774885574.0, 'created_time': 1774608087.854586, 'last_price_update_time': 1774809885.485872}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS78216') HTTP/1.1" 204 0
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for RF27065: 2
2026-03-29 18:44:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-29 18:44:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67315f09-84fc-51a6-941b-c423ccf4d077 with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67315f09-84fc-51a6-941b-c423ccf4d077 with scrape type 2
2026-03-29 18:44:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67315f09-84fc-51a6-941b-c423ccf4d077, identifier: RF27065
2026-03-29 18:44:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-29 18:44:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-29 18:44:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065 to the API
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:42:23Z',
'fuel_type': 'petrol',
'id': '67315f09-84fc-51a6-941b-c423ccf4d077',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF27065',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i40',
'odometer': 158589,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-25',
'seller_name': None,
'title': 'Hyundai i40 1.6 5 Star Edition',
'transmission': 'manual',
'trim': '5 Star Edition',
'year': 2013}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Saving data for RF27065: {'auction_closing_time': 1774885343.0, 'created_time': 1773306092.223411, 'last_price_update_time': 1774809885.948073}
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF27065') HTTP/1.1" 204 0
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-29 18:44:45 [auto1.de] INFO: Scrape type for ZS85810: 0
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-29 18:44:45 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for AY25775: 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for XP68837: 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for NX37466: 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for UK63230: 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for XN11461: 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for EL53532: 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for LA48706: 2
2026-03-29 18:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-29 18:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593bce64-97e7-5de4-86ab-55df8b57ec8f with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593bce64-97e7-5de4-86ab-55df8b57ec8f with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 593bce64-97e7-5de4-86ab-55df8b57ec8f, identifier: LA48706
2026-03-29 18:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-29 18:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706
2026-03-29 18:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 593bce64-97e7-5de4-86ab-55df8b57ec8f with identifier: LA48706 to the API
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:01:37Z',
'fuel_type': 'petrol',
'id': '593bce64-97e7-5de4-86ab-55df8b57ec8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA48706',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 58265,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-12',
'seller_name': None,
'title': 'Kia Picanto 1.0 Dream Team',
'transmission': 'manual',
'trim': 'Dream Team',
'year': 2017}
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Saving data for LA48706: {'auction_closing_time': 1774882897.0, 'created_time': 1774521565.02783, 'last_price_update_time': 1774809886.568959}
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA48706') HTTP/1.1" 204 0
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-29 18:44:46 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-29 18:44:46 [auto1.de] INFO: Scrape type for PS90319: 2
2026-03-29 18:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-29 18:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6872f563-e08c-5155-9b5b-185c006a69d5 with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6872f563-e08c-5155-9b5b-185c006a69d5 with scrape type 2
2026-03-29 18:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6872f563-e08c-5155-9b5b-185c006a69d5, identifier: PS90319
2026-03-29 18:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-29 18:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319
2026-03-29 18:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6872f563-e08c-5155-9b5b-185c006a69d5 with identifier: PS90319 to the API
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:49:57Z',
'fuel_type': 'diesel',
'id': '6872f563-e08c-5155-9b5b-185c006a69d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS90319',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 48073,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-10',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2019}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Saving data for PS90319: {'auction_closing_time': 1774885797.0, 'created_time': 1774522017.143249, 'last_price_update_time': 1774809887.074589}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS90319') HTTP/1.1" 204 0
2026-03-29 18:44:47 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Scrape type for RJ18784: 0
2026-03-29 18:44:47 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Scrape type for HW74456: 0
2026-03-29 18:44:47 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Scrape type for YT31718: 2
2026-03-29 18:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-29 18:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033, identifier: YT31718
2026-03-29 18:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-29 18:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718
2026-03-29 18:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab3c1070-36f4-51fb-97b1-4cd4b3cb1033 with identifier: YT31718 to the API
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:30:10Z',
'fuel_type': 'petrol',
'id': 'ab3c1070-36f4-51fb-97b1-4cd4b3cb1033',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT31718',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 115289,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-20',
'seller_name': None,
'title': 'BMW 3er 325i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2012}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Saving data for YT31718: {'auction_closing_time': 1774884610.0, 'created_time': 1774522480.458332, 'last_price_update_time': 1774809887.511168}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT31718') HTTP/1.1" 204 0
2026-03-29 18:44:47 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Scrape type for BA02242: 2
2026-03-29 18:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-29 18:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988c78ac-9879-586e-a5ff-3af448bc5097 with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 988c78ac-9879-586e-a5ff-3af448bc5097 with scrape type 2
2026-03-29 18:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 988c78ac-9879-586e-a5ff-3af448bc5097, identifier: BA02242
2026-03-29 18:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-29 18:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-29 18:44:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242 to the API
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:53:21Z',
'fuel_type': 'petrol',
'id': '988c78ac-9879-586e-a5ff-3af448bc5097',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA02242',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 184407,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-29 18:44:47 [auto1.de] INFO: Saving data for BA02242: {'auction_closing_time': 1774886001.0, 'created_time': 1773861701.373535, 'last_price_update_time': 1774809887.973064}
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA02242') HTTP/1.1" 204 0
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Scrape type for MX79326: 2
2026-03-29 18:44:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-29 18:44:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaa4533-b143-5fda-bf73-c29838d4feb1 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebaa4533-b143-5fda-bf73-c29838d4feb1 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebaa4533-b143-5fda-bf73-c29838d4feb1, identifier: MX79326
2026-03-29 18:44:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-29 18:44:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-29 18:44:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326 to the API
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:56:19Z',
'fuel_type': 'petrol',
'id': 'ebaa4533-b143-5fda-bf73-c29838d4feb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX79326',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 127027,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-14',
'seller_name': None,
'title': 'Citroen C3 1.4 Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2008}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Saving data for MX79326: {'auction_closing_time': 1774886179.0, 'created_time': 1774290986.750902, 'last_price_update_time': 1774809888.481856}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX79326') HTTP/1.1" 204 0
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-29 18:44:48 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Scrape type for XP57282: 2
2026-03-29 18:44:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-29 18:44:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with scrape type 2
2026-03-29 18:44:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cf53482-cc35-5f32-8bdd-bd28d0971f95, identifier: XP57282
2026-03-29 18:44:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-29 18:44:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-29 18:44:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282 to the API
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:51:42Z',
'fuel_type': 'petrol',
'id': '5cf53482-cc35-5f32-8bdd-bd28d0971f95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP57282',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 104722,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-13',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2015}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-29 18:44:48 [auto1.de] INFO: Saving data for XP57282: {'auction_closing_time': 1774885902.0, 'created_time': 1773381586.467769, 'last_price_update_time': 1774809888.957653}
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP57282') HTTP/1.1" 204 0
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Scrape type for XR37106: 2
2026-03-29 18:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-29 18:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55bd07a-af40-55a0-a940-fe4573b2fb90 with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55bd07a-af40-55a0-a940-fe4573b2fb90 with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e55bd07a-af40-55a0-a940-fe4573b2fb90, identifier: XR37106
2026-03-29 18:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-29 18:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-29 18:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106 to the API
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:13Z',
'fuel_type': 'diesel',
'id': 'e55bd07a-af40-55a0-a940-fe4573b2fb90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR37106',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 24278,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-22',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Goal',
'transmission': 'automatic',
'trim': 'Goal',
'year': 2024}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Saving data for XR37106: {'auction_closing_time': 1774885813.0, 'created_time': 1773134625.719167, 'last_price_update_time': 1774809889.506432}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR37106') HTTP/1.1" 204 0
2026-03-29 18:44:49 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Scrape type for CZ08846: 2
2026-03-29 18:44:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-29 18:44:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb34ff7-682c-530c-81a5-fee68133c246 with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bb34ff7-682c-530c-81a5-fee68133c246 with scrape type 2
2026-03-29 18:44:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bb34ff7-682c-530c-81a5-fee68133c246, identifier: CZ08846
2026-03-29 18:44:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-29 18:44:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-29 18:44:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846 to the API
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:28:00Z',
'fuel_type': 'petrol',
'id': '4bb34ff7-682c-530c-81a5-fee68133c246',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ08846',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 48174,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seller_name': None,
'title': 'Mazda 3 2.0 Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2017}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-29 18:44:49 [auto1.de] INFO: Saving data for CZ08846: {'auction_closing_time': 1774884480.0, 'created_time': 1773380482.275538, 'last_price_update_time': 1774809889.977597}
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ08846') HTTP/1.1" 204 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for MR02811: 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-29 18:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:50 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for CU12004: 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for KW63428: 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for VX83538: 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for SG68469: 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for MB29022: 0
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for KF96570: 2
2026-03-29 18:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-29 18:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49549133-b2d6-51ef-961b-e38cbc7b2dab with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49549133-b2d6-51ef-961b-e38cbc7b2dab with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49549133-b2d6-51ef-961b-e38cbc7b2dab, identifier: KF96570
2026-03-29 18:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-29 18:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-29 18:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570 to the API
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:03:20Z',
'fuel_type': 'diesel',
'id': '49549133-b2d6-51ef-961b-e38cbc7b2dab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF96570',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 224583,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-05',
'seller_name': None,
'title': 'BMW 3er 320d xDrive Sport Line',
'transmission': 'automatic',
'trim': 'xDrive Sport Line',
'year': 2017}
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Saving data for KF96570: {'auction_closing_time': 1774883000.0, 'created_time': 1773775307.509811, 'last_price_update_time': 1774809890.646834}
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF96570') HTTP/1.1" 204 0
2026-03-29 18:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-29 18:44:50 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-29 18:44:50 [auto1.de] INFO: Scrape type for LM29335: 2
2026-03-29 18:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-29 18:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc3c853-802f-5962-991c-25050f35a253 with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc3c853-802f-5962-991c-25050f35a253 with scrape type 2
2026-03-29 18:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffc3c853-802f-5962-991c-25050f35a253, identifier: LM29335
2026-03-29 18:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-29 18:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-29 18:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335 to the API
2026-03-29 18:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:38:43Z',
'fuel_type': 'diesel',
'id': 'ffc3c853-802f-5962-991c-25050f35a253',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM29335',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 188568,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Saving data for LM29335: {'auction_closing_time': 1774885123.0, 'created_time': 1773830710.363106, 'last_price_update_time': 1774809891.243972}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM29335') HTTP/1.1" 204 0
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Scrape type for TS36559: 2
2026-03-29 18:44:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-29 18:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30687c1f-da00-51ca-a284-0ac97a3dd676 with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30687c1f-da00-51ca-a284-0ac97a3dd676 with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30687c1f-da00-51ca-a284-0ac97a3dd676, identifier: TS36559
2026-03-29 18:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-29 18:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-29 18:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559 to the API
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:56:31Z',
'fuel_type': 'petrol',
'id': '30687c1f-da00-51ca-a284-0ac97a3dd676',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS36559',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 149965,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-06',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Saving data for TS36559: {'auction_closing_time': 1774886191.0, 'created_time': 1774608306.725129, 'last_price_update_time': 1774809891.677829}
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS36559') HTTP/1.1" 204 0
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-29 18:44:51 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-29 18:44:51 [auto1.de] INFO: Scrape type for JG35901: 2
2026-03-29 18:44:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-29 18:44:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d36106-5c9a-596d-8d83-23deec829d4e with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d36106-5c9a-596d-8d83-23deec829d4e with scrape type 2
2026-03-29 18:44:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d36106-5c9a-596d-8d83-23deec829d4e, identifier: JG35901
2026-03-29 18:44:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-29 18:44:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901
2026-03-29 18:44:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d36106-5c9a-596d-8d83-23deec829d4e with identifier: JG35901 to the API
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:39:18Z',
'fuel_type': 'petrol',
'id': '79d36106-5c9a-596d-8d83-23deec829d4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35901',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 121500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-04',
'seller_name': None,
'title': 'Volkswagen Scirocco 2.0 TSI BlueMotion',
'transmission': 'manual',
'trim': 'BlueMotion',
'year': 2014}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Saving data for JG35901: {'auction_closing_time': 1774885158.0, 'created_time': 1773945741.360783, 'last_price_update_time': 1774809892.120307}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35901') HTTP/1.1" 204 0
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Scrape type for MM26865: 2
2026-03-29 18:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-29 18:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5, identifier: MM26865
2026-03-29 18:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-29 18:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865
2026-03-29 18:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5 with identifier: MM26865 to the API
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:36:08Z',
'fuel_type': 'diesel',
'id': 'f1d6fb61-67b1-53dd-9bb1-12ea4ef36da5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM26865',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 213560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-18',
'seller_name': None,
'title': 'BMW X3 xDrive 35d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Saving data for MM26865: {'auction_closing_time': 1774884968.0, 'created_time': 1774521547.303999, 'last_price_update_time': 1774809892.617384}
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM26865') HTTP/1.1" 204 0
2026-03-29 18:44:52 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-29 18:44:52 [auto1.de] INFO: Scrape type for DG62846: 2
2026-03-29 18:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-29 18:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5400fba-3052-52cc-9d93-1ee91d165148 with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5400fba-3052-52cc-9d93-1ee91d165148 with scrape type 2
2026-03-29 18:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5400fba-3052-52cc-9d93-1ee91d165148, identifier: DG62846
2026-03-29 18:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-29 18:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-29 18:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846 to the API
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:00:20Z',
'fuel_type': 'petrol',
'id': 'd5400fba-3052-52cc-9d93-1ee91d165148',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG62846',
'listing': 'auction',
'make': 'Ford',
'model': 'Ka',
'odometer': 57628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-31',
'seller_name': None,
'title': 'Ford Ka 1.2 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Saving data for DG62846: {'auction_closing_time': 1774882820.0, 'created_time': 1773659096.375404, 'last_price_update_time': 1774809893.084117}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG62846') HTTP/1.1" 204 0
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Scrape type for KZ05104: 2
2026-03-29 18:44:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-29 18:44:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518a77ff-2195-5e0d-9084-09893dfa3bad with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 518a77ff-2195-5e0d-9084-09893dfa3bad with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 518a77ff-2195-5e0d-9084-09893dfa3bad, identifier: KZ05104
2026-03-29 18:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-29 18:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-29 18:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104 to the API
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:03:15Z',
'fuel_type': 'petrol',
'id': '518a77ff-2195-5e0d-9084-09893dfa3bad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ05104',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 91783,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-29',
'seller_name': None,
'title': 'Hyundai i10 1.1 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2012}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Saving data for KZ05104: {'auction_closing_time': 1774882995.0, 'created_time': 1773772606.582612, 'last_price_update_time': 1774809893.560912}
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ05104') HTTP/1.1" 204 0
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Scrape type for BS47149: 0
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-29 18:44:53 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-29 18:44:53 [auto1.de] INFO: Scrape type for AS09440: 2
2026-03-29 18:44:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-29 18:44:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675cf196-b202-5fca-90af-a3c77b8bb2f3 with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675cf196-b202-5fca-90af-a3c77b8bb2f3 with scrape type 2
2026-03-29 18:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675cf196-b202-5fca-90af-a3c77b8bb2f3, identifier: AS09440
2026-03-29 18:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-29 18:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-29 18:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440 to the API
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:11:29Z',
'fuel_type': 'diesel',
'id': '675cf196-b202-5fca-90af-a3c77b8bb2f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS09440',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 60319,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-19',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L1H1 3,0t Komfort',
'transmission': 'manual',
'trim': 'L1H1 3,0t Komfort',
'year': 2019}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Saving data for AS09440: {'auction_closing_time': 1774883489.0, 'created_time': 1774251399.23677, 'last_price_update_time': 1774809894.058873}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS09440') HTTP/1.1" 204 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for KX86126: 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for FW84065: 2
2026-03-29 18:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-29 18:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e003a27-8c1c-51cb-b27b-70faf71aabeb with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e003a27-8c1c-51cb-b27b-70faf71aabeb with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e003a27-8c1c-51cb-b27b-70faf71aabeb, identifier: FW84065
2026-03-29 18:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-29 18:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-29 18:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065 to the API
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:56:29Z',
'fuel_type': 'diesel',
'id': '4e003a27-8c1c-51cb-b27b-70faf71aabeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW84065',
'listing': 'auction',
'make': 'Citroen',
'model': 'C-Crosser',
'odometer': 195626,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-06-04',
'seller_name': None,
'title': 'Citroen C-Crosser 2.2 HDi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2008}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Saving data for FW84065: {'auction_closing_time': 1774886189.0, 'created_time': 1773946450.424906, 'last_price_update_time': 1774809894.641502}
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW84065') HTTP/1.1" 204 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for ND74491: 0
2026-03-29 18:44:54 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for KM26302: 0
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-29 18:44:54 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-29 18:44:54 [auto1.de] INFO: Scrape type for SK36887: 2
2026-03-29 18:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-29 18:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe976862-08ce-54f4-a9a7-2d63afbb4567 with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe976862-08ce-54f4-a9a7-2d63afbb4567 with scrape type 2
2026-03-29 18:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe976862-08ce-54f4-a9a7-2d63afbb4567, identifier: SK36887
2026-03-29 18:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-29 18:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-29 18:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887 to the API
2026-03-29 18:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:20:25Z',
'fuel_type': 'petrol',
'id': 'fe976862-08ce-54f4-a9a7-2d63afbb4567',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK36887',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 81942,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-25',
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Diamant Edition+ 4WD',
'transmission': 'automatic',
'trim': 'Diamant Edition+ 4WD',
'year': 2019}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Saving data for SK36887: {'auction_closing_time': 1774884025.0, 'created_time': 1773304653.377913, 'last_price_update_time': 1774809895.279439}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK36887') HTTP/1.1" 204 0
2026-03-29 18:44:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for FB70760: 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for TV20692: 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for LV55762: 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for KH49369: 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for AS68475: 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for EL15513: 2
2026-03-29 18:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-29 18:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f006a16-8817-5735-8416-713c79e81536 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f006a16-8817-5735-8416-713c79e81536 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f006a16-8817-5735-8416-713c79e81536, identifier: EL15513
2026-03-29 18:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-29 18:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513
2026-03-29 18:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f006a16-8817-5735-8416-713c79e81536 with identifier: EL15513 to the API
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:17:05Z',
'fuel_type': 'diesel',
'id': '8f006a16-8817-5735-8416-713c79e81536',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL15513',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 184203,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-17',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Saving data for EL15513: {'auction_closing_time': 1774883825.0, 'created_time': 1774522205.902894, 'last_price_update_time': 1774809895.78483}
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL15513') HTTP/1.1" 204 0
2026-03-29 18:44:55 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-29 18:44:55 [auto1.de] INFO: Scrape type for FY57679: 2
2026-03-29 18:44:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-29 18:44:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with scrape type 2
2026-03-29 18:44:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6ca2c54-5030-5f3a-8640-b78c7fd2f325, identifier: FY57679
2026-03-29 18:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-29 18:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-29 18:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679 to the API
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 292,
'expiration_date': '2026-03-30T15:47:16Z',
'fuel_type': 'hybrid',
'id': 'e6ca2c54-5030-5f3a-8640-b78c7fd2f325',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY57679',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 68902,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-17',
'seller_name': None,
'title': 'BMW X3 xDrive 30e',
'transmission': 'automatic',
'trim': '',
'year': 2022}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Saving data for FY57679: {'auction_closing_time': 1774885636.0, 'created_time': 1773775424.423979, 'last_price_update_time': 1774809896.380898}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY57679') HTTP/1.1" 204 0
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Scrape type for YR50974: 0
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Scrape type for BB57132: 2
2026-03-29 18:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-29 18:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f, identifier: BB57132
2026-03-29 18:44:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-29 18:44:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-29 18:44:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132 to the API
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:22:14Z',
'fuel_type': 'diesel',
'id': '382b96ba-cfd1-5b9e-b3ae-87896a477e7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB57132',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 139997,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-21',
'seller_name': None,
'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Saving data for BB57132: {'auction_closing_time': 1774884134.0, 'created_time': 1773307517.033165, 'last_price_update_time': 1774809896.895446}
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB57132') HTTP/1.1" 204 0
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Scrape type for TG41026: 0
2026-03-29 18:44:56 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-29 18:44:56 [auto1.de] INFO: Scrape type for XH41107: 2
2026-03-29 18:44:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-29 18:44:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abd48081-2a26-54d5-b6c7-5a0e42b898fd with scrape type 2
2026-03-29 18:44:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abd48081-2a26-54d5-b6c7-5a0e42b898fd with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abd48081-2a26-54d5-b6c7-5a0e42b898fd, identifier: XH41107
2026-03-29 18:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-29 18:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-29 18:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107 to the API
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:01:51Z',
'fuel_type': 'petrol',
'id': 'abd48081-2a26-54d5-b6c7-5a0e42b898fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41107',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 75971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-30',
'seller_name': None,
'title': 'Opel Astra 1.2 Turbo Edition Start/Stop',
'transmission': 'manual',
'trim': 'Edition Start/Stop',
'year': 2020}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Saving data for XH41107: {'auction_closing_time': 1774882911.0, 'created_time': 1774291419.585148, 'last_price_update_time': 1774809897.36982}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH41107') HTTP/1.1" 204 0
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Scrape type for MA81482: 2
2026-03-29 18:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-29 18:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710a572e-edd9-5abc-8bae-0b24e758d3ab with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710a572e-edd9-5abc-8bae-0b24e758d3ab with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710a572e-edd9-5abc-8bae-0b24e758d3ab, identifier: MA81482
2026-03-29 18:44:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-29 18:44:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-29 18:44:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482 to the API
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:26:44Z',
'fuel_type': 'petrol',
'id': '710a572e-edd9-5abc-8bae-0b24e758d3ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA81482',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 107265,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-20',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2021}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Saving data for MA81482: {'auction_closing_time': 1774884404.0, 'created_time': 1773402369.125346, 'last_price_update_time': 1774809897.837521}
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA81482') HTTP/1.1" 204 0
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Scrape type for DR63212: 0
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-29 18:44:57 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-29 18:44:57 [auto1.de] INFO: Scrape type for GV00084: 2
2026-03-29 18:44:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-29 18:44:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with scrape type 2
2026-03-29 18:44:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6, identifier: GV00084
2026-03-29 18:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-29 18:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-29 18:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084 to the API
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:14:29Z',
'fuel_type': 'diesel',
'id': 'fb777bb0-50dc-5dcf-8f94-81f9a66d26b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV00084',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 123712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-24',
'seller_name': None,
'title': 'Peugeot 308 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2018}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Saving data for GV00084: {'auction_closing_time': 1774883669.0, 'created_time': 1774002225.84921, 'last_price_update_time': 1774809898.429172}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV00084') HTTP/1.1" 204 0
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Scrape type for UC15982: 0
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Scrape type for NV35825: 2
2026-03-29 18:44:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-29 18:44:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with scrape type 2
2026-03-29 18:44:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0, identifier: NV35825
2026-03-29 18:44:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-29 18:44:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-29 18:44:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825 to the API
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:44:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:50:43Z',
'fuel_type': 'diesel',
'id': '5a0f9732-f4a7-5a17-a2d0-4ab1561931e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV35825',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 58701,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-17',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
'transmission': 'automatic',
'trim': 'Style 4x4',
'year': 2019}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-29 18:44:58 [auto1.de] INFO: Saving data for NV35825: {'auction_closing_time': 1774885843.0, 'created_time': 1774608606.832805, 'last_price_update_time': 1774809898.91211}
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV35825') HTTP/1.1" 204 0
2026-03-29 18:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-29 18:44:58 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-29 18:44:59 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6740 | hits on page: 40
2026-03-29 18:44:59 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-29 18:44:59 [auto1.de] INFO: Scrape type for XS67256: 2
2026-03-29 18:44:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-29 18:44:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e527202-c413-5ec0-8f06-997fa5d36237 with scrape type 2
2026-03-29 18:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e527202-c413-5ec0-8f06-997fa5d36237 with scrape type 2
2026-03-29 18:44:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e527202-c413-5ec0-8f06-997fa5d36237, identifier: XS67256
2026-03-29 18:44:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-29 18:44:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-29 18:44:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256 to the API
2026-03-29 18:44:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:06:32Z',
'fuel_type': 'petrol',
'id': '3e527202-c413-5ec0-8f06-997fa5d36237',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS67256',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 189175,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-30',
'seller_name': None,
'title': 'Fiat 500C 0.9 TwinAir Plus',
'transmission': 'manual',
'trim': 'TwinAir Plus',
'year': 2011}
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-29 18:45:00 [auto1.de] INFO: Saving data for XS67256: {'auction_closing_time': 1774883192.0, 'created_time': 1774350402.095544, 'last_price_update_time': 1774809900.450864}
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS67256') HTTP/1.1" 204 0
2026-03-29 18:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-29 18:45:00 [auto1.de] INFO: Found listing with ID: US02416
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-29 18:45:00 [auto1.de] INFO: Scrape type for US02416: 2
2026-03-29 18:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-29 18:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a63059-8058-5728-b6e8-d885d00603d7 with scrape type 2
2026-03-29 18:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a63059-8058-5728-b6e8-d885d00603d7 with scrape type 2
2026-03-29 18:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28a63059-8058-5728-b6e8-d885d00603d7, identifier: US02416
2026-03-29 18:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-29 18:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-29 18:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416 to the API
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:49:11Z',
'fuel_type': 'petrol',
'id': '28a63059-8058-5728-b6e8-d885d00603d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US02416',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 148453,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-30',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2008}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Saving data for US02416: {'auction_closing_time': 1774885751.0, 'created_time': 1773307836.987222, 'last_price_update_time': 1774809901.0399}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US02416') HTTP/1.1" 204 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for WE95129: 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for BJ13428: 2
2026-03-29 18:45:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-29 18:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc47f720-0a2b-59f0-a249-ab17fbc46c7b, identifier: BJ13428
2026-03-29 18:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-29 18:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-29 18:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428 to the API
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:51:34Z',
'fuel_type': 'petrol',
'id': 'dc47f720-0a2b-59f0-a249-ab17fbc46c7b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ13428',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 96997,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-20',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Saving data for BJ13428: {'auction_closing_time': 1774885894.0, 'created_time': 1774608167.353307, 'last_price_update_time': 1774809901.619483}
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ13428') HTTP/1.1" 204 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for ZS85358: 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for YT62931: 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for WV85362: 0
2026-03-29 18:45:01 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-29 18:45:01 [auto1.de] INFO: Scrape type for LN73181: 2
2026-03-29 18:45:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-29 18:45:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf6b590-2465-5226-bcdb-a5e3f0b6181c with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf6b590-2465-5226-bcdb-a5e3f0b6181c with scrape type 2
2026-03-29 18:45:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf6b590-2465-5226-bcdb-a5e3f0b6181c, identifier: LN73181
2026-03-29 18:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-29 18:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-29 18:45:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181 to the API
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:51:25Z',
'fuel_type': 'diesel',
'id': 'faf6b590-2465-5226-bcdb-a5e3f0b6181c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN73181',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 168467,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-09',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2013}
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Saving data for LN73181: {'auction_closing_time': 1774885885.0, 'created_time': 1773305947.44444, 'last_price_update_time': 1774809902.357891}
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN73181') HTTP/1.1" 204 0
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Scrape type for DR68264: 0
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Scrape type for FP07382: 0
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-29 18:45:02 [auto1.de] INFO: Scrape type for AV64816: 0
2026-03-29 18:45:02 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-29 18:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:03 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-29 18:45:03 [auto1.de] INFO: Scrape type for FX01006: 2
2026-03-29 18:45:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-29 18:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce27b9d4-36f6-5d0c-82a4-7c92466a5889, identifier: FX01006
2026-03-29 18:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-29 18:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006
2026-03-29 18:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce27b9d4-36f6-5d0c-82a4-7c92466a5889 with identifier: FX01006 to the API
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:29:40Z',
'fuel_type': 'hybrid',
'id': 'ce27b9d4-36f6-5d0c-82a4-7c92466a5889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX01006',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 42131,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-19',
'seller_name': None,
'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
'transmission': 'automatic',
'trim': 'VZ',
'year': 2022}
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-29 18:45:03 [auto1.de] INFO: Saving data for FX01006: {'auction_closing_time': 1774884580.0, 'created_time': 1774522636.754868, 'last_price_update_time': 1774809903.645062}
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX01006') HTTP/1.1" 204 0
2026-03-29 18:45:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-29 18:45:03 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95503%27 HTTP/1.1" 200 None
2026-03-29 18:45:03 [auto1.de] INFO: Scrape type for MH95503: 2
2026-03-29 18:45:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503
2026-03-29 18:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46e2809-bb2f-5a06-ad98-f14ab1678f5f with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d46e2809-bb2f-5a06-ad98-f14ab1678f5f with scrape type 2
2026-03-29 18:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d46e2809-bb2f-5a06-ad98-f14ab1678f5f, identifier: MH95503
2026-03-29 18:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503
2026-03-29 18:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503
2026-03-29 18:45:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d46e2809-bb2f-5a06-ad98-f14ab1678f5f with identifier: MH95503 to the API
2026-03-29 18:45:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:11:08Z',
'fuel_type': 'petrol',
'id': 'd46e2809-bb2f-5a06-ad98-f14ab1678f5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH95503',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 99094,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-27',
'seller_name': None,
'title': 'Jeep Compass 2.4 Limited 4x4',
'transmission': 'automatic',
'trim': 'Limited 4x4',
'year': 2016}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95503%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Saving data for MH95503: {'auction_closing_time': 1774883468.0, 'created_time': 1774723277.188305, 'last_price_update_time': 1774809904.161309}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH95503') HTTP/1.1" 204 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for KS07911: 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for EY62389: 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for NY59732: 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for FX39792: 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for CN74001: 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for GR89322: 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for AR51863: 2
2026-03-29 18:45:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-29 18:45:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca696def-5809-59c0-9ae7-b3c41456be99 with scrape type 2
2026-03-29 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca696def-5809-59c0-9ae7-b3c41456be99 with scrape type 2
2026-03-29 18:45:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca696def-5809-59c0-9ae7-b3c41456be99, identifier: AR51863
2026-03-29 18:45:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-29 18:45:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-29 18:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863 to the API
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:53:45Z',
'fuel_type': 'petrol',
'id': 'ca696def-5809-59c0-9ae7-b3c41456be99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR51863',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 81673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'Ford B-Max 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Saving data for AR51863: {'auction_closing_time': 1774886025.0, 'created_time': 1773303654.201246, 'last_price_update_time': 1774809904.774923}
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR51863') HTTP/1.1" 204 0
2026-03-29 18:45:04 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-29 18:45:04 [auto1.de] INFO: Scrape type for ZP29614: 2
2026-03-29 18:45:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-29 18:45:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff3db46-c194-5187-9ec7-67543c85209e with scrape type 2
2026-03-29 18:45:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ff3db46-c194-5187-9ec7-67543c85209e with scrape type 2
2026-03-29 18:45:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ff3db46-c194-5187-9ec7-67543c85209e, identifier: ZP29614
2026-03-29 18:45:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-29 18:45:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-29 18:45:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614 to the API
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:32:19Z',
'fuel_type': 'diesel',
'id': '6ff3db46-c194-5187-9ec7-67543c85209e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP29614',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 166750,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-11',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi EcoBlue Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2023}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Saving data for ZP29614: {'auction_closing_time': 1774884739.0, 'created_time': 1774607963.910998, 'last_price_update_time': 1774809905.318846}
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP29614') HTTP/1.1" 204 0
2026-03-29 18:45:05 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-29 18:45:05 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-29 18:45:05 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-29 18:45:05 [auto1.de] INFO: Scrape type for KH41700: 0
2026-03-29 18:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:06 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-29 18:45:06 [auto1.de] INFO: Scrape type for WT06572: 2
2026-03-29 18:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-29 18:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde659ec-0fb7-5057-af9d-5776be325a82 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde659ec-0fb7-5057-af9d-5776be325a82 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde659ec-0fb7-5057-af9d-5776be325a82, identifier: WT06572
2026-03-29 18:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-29 18:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-29 18:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572 to the API
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:12:28Z',
'fuel_type': 'diesel',
'id': 'cde659ec-0fb7-5057-af9d-5776be325a82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06572',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 205087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-29',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport & Style BlueMotion Tech',
'year': 2012}
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-29 18:45:06 [auto1.de] INFO: Saving data for WT06572: {'auction_closing_time': 1774883548.0, 'created_time': 1773230220.791237, 'last_price_update_time': 1774809906.703435}
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT06572') HTTP/1.1" 204 0
2026-03-29 18:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-29 18:45:06 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-29 18:45:06 [auto1.de] INFO: Scrape type for CY25945: 2
2026-03-29 18:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-29 18:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df25dfcc-c940-5b2c-b541-9ecfda37a889 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df25dfcc-c940-5b2c-b541-9ecfda37a889 with scrape type 2
2026-03-29 18:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df25dfcc-c940-5b2c-b541-9ecfda37a889, identifier: CY25945
2026-03-29 18:45:06 [scrapy.extensions.logstats] INFO: Crawled 120 pages (at 13 pages/min), scraped 1001 items (at 110 items/min)
2026-03-29 18:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-29 18:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945
2026-03-29 18:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df25dfcc-c940-5b2c-b541-9ecfda37a889 with identifier: CY25945 to the API
2026-03-29 18:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:05:03Z',
'fuel_type': 'petrol',
'id': 'df25dfcc-c940-5b2c-b541-9ecfda37a889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY25945',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 68696,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-12-18',
'seller_name': None,
'title': 'Opel Corsa 1.0 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2005}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Saving data for CY25945: {'auction_closing_time': 1774883103.0, 'created_time': 1774001890.007442, 'last_price_update_time': 1774809907.119235}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY25945') HTTP/1.1" 204 0
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Scrape type for GH39417: 2
2026-03-29 18:45:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417
2026-03-29 18:45:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d, identifier: GH39417
2026-03-29 18:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417
2026-03-29 18:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417
2026-03-29 18:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a2a0827-1509-5fec-88fe-7b5303cb4c9d with identifier: GH39417 to the API
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 239,
'expiration_date': '2026-03-30T15:28:43Z',
'fuel_type': 'diesel',
'id': '9a2a0827-1509-5fec-88fe-7b5303cb4c9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH39417',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 131335,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-01',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 300 d EDITION kompakt',
'transmission': 'automatic',
'trim': 'EDITION kompakt',
'year': 2020}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Saving data for GH39417: {'auction_closing_time': 1774884523.0, 'created_time': 1773138329.981538, 'last_price_update_time': 1774809907.54955}
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH39417') HTTP/1.1" 204 0
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Scrape type for AU39005: 0
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Scrape type for CP06535: 0
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Scrape type for EU93663: 0
2026-03-29 18:45:07 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-29 18:45:07 [auto1.de] INFO: Scrape type for AZ37362: 2
2026-03-29 18:45:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-29 18:45:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c378422-00d0-5dec-93ef-2380983fa76e with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c378422-00d0-5dec-93ef-2380983fa76e with scrape type 2
2026-03-29 18:45:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c378422-00d0-5dec-93ef-2380983fa76e, identifier: AZ37362
2026-03-29 18:45:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-29 18:45:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-29 18:45:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362 to the API
2026-03-29 18:45:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:03:11Z',
'fuel_type': 'petrol',
'id': '7c378422-00d0-5dec-93ef-2380983fa76e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ37362',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 145058,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-18',
'seller_name': None,
'title': 'Suzuki Swift 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Saving data for AZ37362: {'auction_closing_time': 1774882991.0, 'created_time': 1774262560.543079, 'last_price_update_time': 1774809908.221874}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ37362') HTTP/1.1" 204 0
2026-03-29 18:45:08 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Scrape type for DJ60943: 2
2026-03-29 18:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-29 18:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1, identifier: DJ60943
2026-03-29 18:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-29 18:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-29 18:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943 to the API
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:20:26Z',
'fuel_type': 'petrol',
'id': '617e169a-c15a-5ed1-8130-d3cf2f5edaa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ60943',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka X',
'odometer': 23560,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-26',
'seller_name': None,
'title': 'Opel Mokka X 1.2 Turbo Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2021}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Saving data for DJ60943: {'auction_closing_time': 1774884026.0, 'created_time': 1773304442.87449, 'last_price_update_time': 1774809908.678253}
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ60943') HTTP/1.1" 204 0
2026-03-29 18:45:08 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Scrape type for YD94034: 0
2026-03-29 18:45:08 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-29 18:45:08 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-29 18:45:08 [auto1.de] INFO: Scrape type for EE47026: 2
2026-03-29 18:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-29 18:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09057ef2-c520-5eca-9db6-88460af5734f with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09057ef2-c520-5eca-9db6-88460af5734f with scrape type 2
2026-03-29 18:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09057ef2-c520-5eca-9db6-88460af5734f, identifier: EE47026
2026-03-29 18:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-29 18:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-29 18:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026 to the API
2026-03-29 18:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:16:14Z',
'fuel_type': 'diesel',
'id': '09057ef2-c520-5eca-9db6-88460af5734f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE47026',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Viano',
'odometer': 95412,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-24',
'seller_name': None,
'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'kompakt BlueEfficiency Avantgarde',
'year': 2013}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Saving data for EE47026: {'auction_closing_time': 1774883774.0, 'created_time': 1774293542.633676, 'last_price_update_time': 1774809909.119308}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE47026') HTTP/1.1" 204 0
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Scrape type for ML30380: 0
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Scrape type for EJ97789: 2
2026-03-29 18:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-29 18:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d212b88-77e7-51df-a6a5-ddfe5688546a with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d212b88-77e7-51df-a6a5-ddfe5688546a with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d212b88-77e7-51df-a6a5-ddfe5688546a, identifier: EJ97789
2026-03-29 18:45:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-29 18:45:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-29 18:45:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789 to the API
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:37Z',
'fuel_type': 'diesel',
'id': '8d212b88-77e7-51df-a6a5-ddfe5688546a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ97789',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 226588,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-23',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'manual',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Saving data for EJ97789: {'auction_closing_time': 1774883317.0, 'created_time': 1773381311.037357, 'last_price_update_time': 1774809909.735155}
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ97789') HTTP/1.1" 204 0
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Scrape type for VC89740: 0
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-29 18:45:09 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-29 18:45:09 [auto1.de] INFO: Scrape type for NC07165: 2
2026-03-29 18:45:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-29 18:45:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e20c78-22ae-553e-bea3-0fb0b9d05184 with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e20c78-22ae-553e-bea3-0fb0b9d05184 with scrape type 2
2026-03-29 18:45:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23e20c78-22ae-553e-bea3-0fb0b9d05184, identifier: NC07165
2026-03-29 18:45:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-29 18:45:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-29 18:45:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165 to the API
2026-03-29 18:45:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:53:42Z',
'fuel_type': 'diesel',
'id': '23e20c78-22ae-553e-bea3-0fb0b9d05184',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC07165',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 152443,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-13',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2013}
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-29 18:45:10 [auto1.de] INFO: Saving data for NC07165: {'auction_closing_time': 1774886022.0, 'created_time': 1773772525.232938, 'last_price_update_time': 1774809910.6771}
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC07165') HTTP/1.1" 204 0
2026-03-29 18:45:10 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-29 18:45:10 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-29 18:45:10 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-29 18:45:10 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-29 18:45:10 [auto1.de] INFO: Scrape type for RA07752: 2
2026-03-29 18:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-29 18:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with scrape type 2
2026-03-29 18:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with scrape type 2
2026-03-29 18:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cc68881-27cf-58d2-8d57-2c290ae3eb12, identifier: RA07752
2026-03-29 18:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-29 18:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-29 18:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752 to the API
2026-03-29 18:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:40:30Z',
'fuel_type': 'petrol',
'id': '1cc68881-27cf-58d2-8d57-2c290ae3eb12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA07752',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 70640,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-21',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
'transmission': 'automatic',
'trim': 'GTI Performance BlueMotion',
'year': 2017}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Saving data for RA07752: {'auction_closing_time': 1774885230.0, 'created_time': 1774608592.55816, 'last_price_update_time': 1774809911.164767}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA07752') HTTP/1.1" 204 0
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Scrape type for AG84988: 2
2026-03-29 18:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-29 18:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1171a299-2a06-56f8-b36d-7f7af785b8eb with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1171a299-2a06-56f8-b36d-7f7af785b8eb with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1171a299-2a06-56f8-b36d-7f7af785b8eb, identifier: AG84988
2026-03-29 18:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-29 18:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988
2026-03-29 18:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1171a299-2a06-56f8-b36d-7f7af785b8eb with identifier: AG84988 to the API
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:27Z',
'fuel_type': 'diesel',
'id': '1171a299-2a06-56f8-b36d-7f7af785b8eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG84988',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 121035,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-25',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2018}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Saving data for AG84988: {'auction_closing_time': 1774884867.0, 'created_time': 1774522102.330151, 'last_price_update_time': 1774809911.685854}
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG84988') HTTP/1.1" 204 0
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Scrape type for UY21095: 0
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Scrape type for WG73343: 0
2026-03-29 18:45:11 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-29 18:45:11 [auto1.de] INFO: Scrape type for VU06993: 2
2026-03-29 18:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-29 18:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with scrape type 2
2026-03-29 18:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa, identifier: VU06993
2026-03-29 18:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-29 18:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993
2026-03-29 18:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 282c5bf3-6ed6-5a9b-b6d8-c17759e784fa with identifier: VU06993 to the API
2026-03-29 18:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:57Z',
'fuel_type': 'petrol',
'id': '282c5bf3-6ed6-5a9b-b6d8-c17759e784fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU06993',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 151876,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'Skoda Octavia 2.0 FSI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2006}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Saving data for VU06993: {'auction_closing_time': 1774884057.0, 'created_time': 1774034890.655815, 'last_price_update_time': 1774809912.125862}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU06993') HTTP/1.1" 204 0
2026-03-29 18:45:12 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Scrape type for SD64601: 2
2026-03-29 18:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-29 18:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4608e656-4065-5d6d-87b2-6ea468e3d790 with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4608e656-4065-5d6d-87b2-6ea468e3d790 with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4608e656-4065-5d6d-87b2-6ea468e3d790, identifier: SD64601
2026-03-29 18:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-29 18:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-29 18:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601 to the API
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:03:02Z',
'fuel_type': 'petrol',
'id': '4608e656-4065-5d6d-87b2-6ea468e3d790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD64601',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 124575,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-17',
'seller_name': None,
'title': 'Renault Megane 1.2 Paris',
'transmission': 'manual',
'trim': 'Paris',
'year': 2013}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Saving data for SD64601: {'auction_closing_time': 1774882982.0, 'created_time': 1773772536.411584, 'last_price_update_time': 1774809912.575362}
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD64601') HTTP/1.1" 204 0
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Scrape type for ME01390: 0
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Scrape type for NK37699: 0
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-29 18:45:12 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-29 18:45:12 [auto1.de] INFO: Scrape type for RB67874: 2
2026-03-29 18:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-29 18:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with scrape type 2
2026-03-29 18:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5, identifier: RB67874
2026-03-29 18:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-29 18:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874
2026-03-29 18:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ecac9bc-d704-58bc-8d24-3c42448ef0a5 with identifier: RB67874 to the API
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:46:00Z',
'fuel_type': 'diesel',
'id': '9ecac9bc-d704-58bc-8d24-3c42448ef0a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB67874',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 276338,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-16',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2010}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Saving data for RB67874: {'auction_closing_time': 1774885560.0, 'created_time': 1773945943.794316, 'last_price_update_time': 1774809913.042549}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB67874') HTTP/1.1" 204 0
2026-03-29 18:45:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Scrape type for HG88240: 2
2026-03-29 18:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-29 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b09b65b3-0f90-5917-b51a-c5d54b1addba with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b09b65b3-0f90-5917-b51a-c5d54b1addba with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b09b65b3-0f90-5917-b51a-c5d54b1addba, identifier: HG88240
2026-03-29 18:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-29 18:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240
2026-03-29 18:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b09b65b3-0f90-5917-b51a-c5d54b1addba with identifier: HG88240 to the API
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:57:09Z',
'fuel_type': 'diesel',
'id': 'b09b65b3-0f90-5917-b51a-c5d54b1addba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG88240',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 259510,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-14',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2016}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Saving data for HG88240: {'auction_closing_time': 1774886229.0, 'created_time': 1773383377.325067, 'last_price_update_time': 1774809913.552077}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG88240') HTTP/1.1" 204 0
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Scrape type for JR29139: 0
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Scrape type for UA34873: 2
2026-03-29 18:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873
2026-03-29 18:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with scrape type 2
2026-03-29 18:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56, identifier: UA34873
2026-03-29 18:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873
2026-03-29 18:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873
2026-03-29 18:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d6ec55a-0b04-5267-85a2-e85b62bd5b56 with identifier: UA34873 to the API
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:51:58Z',
'fuel_type': 'diesel',
'id': '3d6ec55a-0b04-5267-85a2-e85b62bd5b56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA34873',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 230697,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-12',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2011}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Saving data for UA34873: {'auction_closing_time': 1774885918.0, 'created_time': 1774350216.811544, 'last_price_update_time': 1774809913.954657}
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA34873') HTTP/1.1" 204 0
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-29 18:45:13 [auto1.de] INFO: Scrape type for CE75609: 0
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-29 18:45:13 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Scrape type for XA05617: 2
2026-03-29 18:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-29 18:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc3c4b08-3b82-5a58-b5e5-282acadf2628 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc3c4b08-3b82-5a58-b5e5-282acadf2628 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc3c4b08-3b82-5a58-b5e5-282acadf2628, identifier: XA05617
2026-03-29 18:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-29 18:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-29 18:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617 to the API
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:16:19Z',
'fuel_type': 'petrol',
'id': 'bc3c4b08-3b82-5a58-b5e5-282acadf2628',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA05617',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 158300,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-31',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Saving data for XA05617: {'auction_closing_time': 1774883779.0, 'created_time': 1773383087.839684, 'last_price_update_time': 1774809914.445825}
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA05617') HTTP/1.1" 204 0
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Scrape type for MX54402: 0
2026-03-29 18:45:14 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-29 18:45:14 [auto1.de] INFO: Scrape type for ES68108: 2
2026-03-29 18:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-29 18:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with scrape type 2
2026-03-29 18:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1803ee4c-aab7-54d1-8d04-2628fd9e4694, identifier: ES68108
2026-03-29 18:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-29 18:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-29 18:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108 to the API
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:22:30Z',
'fuel_type': 'diesel',
'id': '1803ee4c-aab7-54d1-8d04-2628fd9e4694',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES68108',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 263130,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-31',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Champions Edition',
'transmission': 'automatic',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Saving data for ES68108: {'auction_closing_time': 1774884150.0, 'created_time': 1773775436.293137, 'last_price_update_time': 1774809915.033715}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES68108') HTTP/1.1" 204 0
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Scrape type for CF39305: 2
2026-03-29 18:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305
2026-03-29 18:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6497bfe5-a8d9-5a35-900b-85514312537d with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6497bfe5-a8d9-5a35-900b-85514312537d with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6497bfe5-a8d9-5a35-900b-85514312537d, identifier: CF39305
2026-03-29 18:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305
2026-03-29 18:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305
2026-03-29 18:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6497bfe5-a8d9-5a35-900b-85514312537d with identifier: CF39305 to the API
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:00:15Z',
'fuel_type': 'diesel',
'id': '6497bfe5-a8d9-5a35-900b-85514312537d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF39305',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 312352,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-31',
'seller_name': None,
'title': 'BMW 3er 320d EfficientDynamics Edition',
'transmission': 'automatic',
'trim': 'EfficientDynamics Edition',
'year': 2013}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Saving data for CF39305: {'auction_closing_time': 1774882815.0, 'created_time': 1773229239.993199, 'last_price_update_time': 1774809915.463106}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF39305') HTTP/1.1" 204 0
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Scrape type for TY32384: 2
2026-03-29 18:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-29 18:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da369dc-a854-54dd-943f-c54b415c679d with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da369dc-a854-54dd-943f-c54b415c679d with scrape type 2
2026-03-29 18:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5da369dc-a854-54dd-943f-c54b415c679d, identifier: TY32384
2026-03-29 18:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-29 18:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-29 18:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384 to the API
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:59Z',
'fuel_type': 'diesel',
'id': '5da369dc-a854-54dd-943f-c54b415c679d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY32384',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 119640,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-02',
'seller_name': None,
'title': 'Toyota RAV 4 2.2 D-4D Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2012}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Saving data for TY32384: {'auction_closing_time': 1774882859.0, 'created_time': 1773401550.580781, 'last_price_update_time': 1774809915.956294}
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY32384') HTTP/1.1" 204 0
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-29 18:45:15 [auto1.de] INFO: Scrape type for HW68760: 0
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-29 18:45:15 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Scrape type for AH85059: 2
2026-03-29 18:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059
2026-03-29 18:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38, identifier: AH85059
2026-03-29 18:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059
2026-03-29 18:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059
2026-03-29 18:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0992afd8-5cc1-5dfa-93d6-ea333a03fc38 with identifier: AH85059 to the API
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:45:12Z',
'fuel_type': 'petrol',
'id': '0992afd8-5cc1-5dfa-93d6-ea333a03fc38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH85059',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 99878,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-30',
'seller_name': None,
'title': 'Audi Q3 40 TFSI quattro S Line',
'transmission': 'automatic',
'trim': 'quattro S Line',
'year': 2019}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Saving data for AH85059: {'auction_closing_time': 1774885512.0, 'created_time': 1773131828.927066, 'last_price_update_time': 1774809916.423782}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH85059') HTTP/1.1" 204 0
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Scrape type for LZ51858: 2
2026-03-29 18:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-29 18:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f35297-b75e-5716-a80f-ec691263f1ed with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f35297-b75e-5716-a80f-ec691263f1ed with scrape type 2
2026-03-29 18:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05f35297-b75e-5716-a80f-ec691263f1ed, identifier: LZ51858
2026-03-29 18:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-29 18:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-29 18:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858 to the API
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:53:12Z',
'fuel_type': 'diesel',
'id': '05f35297-b75e-5716-a80f-ec691263f1ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ51858',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 397963,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2017}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-29 18:45:16 [auto1.de] INFO: Saving data for LZ51858: {'auction_closing_time': 1774885992.0, 'created_time': 1773861292.230411, 'last_price_update_time': 1774809916.865726}
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ51858') HTTP/1.1" 204 0
2026-03-29 18:45:16 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-29 18:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for MS39817: 0
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for YM15583: 2
2026-03-29 18:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583
2026-03-29 18:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e999e5a4-f559-5088-8042-c09ba686e57c with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e999e5a4-f559-5088-8042-c09ba686e57c with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e999e5a4-f559-5088-8042-c09ba686e57c, identifier: YM15583
2026-03-29 18:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583
2026-03-29 18:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583
2026-03-29 18:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e999e5a4-f559-5088-8042-c09ba686e57c with identifier: YM15583 to the API
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 207,
'expiration_date': '2026-03-30T15:45:12Z',
'fuel_type': 'petrol',
'id': 'e999e5a4-f559-5088-8042-c09ba686e57c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM15583',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 42691,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-29',
'seller_name': None,
'title': 'Audi A1 Sportback 40 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Saving data for YM15583: {'auction_closing_time': 1774885512.0, 'created_time': 1773831321.699364, 'last_price_update_time': 1774809917.407743}
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM15583') HTTP/1.1" 204 0
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for TD61700: 0
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for AD93379: 0
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-29 18:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:17 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for VN62534: 0
2026-03-29 18:45:17 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-29 18:45:17 [auto1.de] INFO: Scrape type for MP24640: 2
2026-03-29 18:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-29 18:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace37f9f-d718-5388-a123-c681744a6d41 with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ace37f9f-d718-5388-a123-c681744a6d41 with scrape type 2
2026-03-29 18:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ace37f9f-d718-5388-a123-c681744a6d41, identifier: MP24640
2026-03-29 18:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-29 18:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-29 18:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640 to the API
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:30:05Z',
'fuel_type': 'petrol',
'id': 'ace37f9f-d718-5388-a123-c681744a6d41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP24640',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 71741,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-15',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Allstar BlueMotion Tech',
'year': 2017}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Saving data for MP24640: {'auction_closing_time': 1774884605.0, 'created_time': 1773858927.865826, 'last_price_update_time': 1774809918.06928}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP24640') HTTP/1.1" 204 0
2026-03-29 18:45:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for BR25220: 0
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for SM54936: 2
2026-03-29 18:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-29 18:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659f7e39-f36d-592e-8b4e-18ed268e3373 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 659f7e39-f36d-592e-8b4e-18ed268e3373 with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 659f7e39-f36d-592e-8b4e-18ed268e3373, identifier: SM54936
2026-03-29 18:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-29 18:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-29 18:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936 to the API
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:42:43Z',
'fuel_type': 'diesel',
'id': '659f7e39-f36d-592e-8b4e-18ed268e3373',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM54936',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Sharan',
'odometer': 330037,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-28',
'seller_name': None,
'title': 'Volkswagen Sharan 1.9 TDI Comfortline Family',
'transmission': 'manual',
'trim': 'Comfortline Family',
'year': 2003}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Saving data for SM54936: {'auction_closing_time': 1774885363.0, 'created_time': 1774608259.002696, 'last_price_update_time': 1774809918.524661}
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM54936') HTTP/1.1" 204 0
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for CG81314: 0
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for UK08756: 0
2026-03-29 18:45:18 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-29 18:45:18 [auto1.de] INFO: Scrape type for KN66940: 2
2026-03-29 18:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-29 18:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd42c97-d63b-5e49-a331-c4f704c080bf with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd42c97-d63b-5e49-a331-c4f704c080bf with scrape type 2
2026-03-29 18:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd42c97-d63b-5e49-a331-c4f704c080bf, identifier: KN66940
2026-03-29 18:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-29 18:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-29 18:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940 to the API
2026-03-29 18:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:17:20Z',
'fuel_type': 'diesel',
'id': '5cd42c97-d63b-5e49-a331-c4f704c080bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN66940',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 228471,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-31',
'seller_name': None,
'title': 'Mercedes-Benz Vito 113 CDI lang',
'transmission': 'automatic',
'trim': 'lang',
'year': 2012}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Saving data for KN66940: {'auction_closing_time': 1774883840.0, 'created_time': 1773831041.714024, 'last_price_update_time': 1774809919.108844}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN66940') HTTP/1.1" 204 0
2026-03-29 18:45:19 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Scrape type for CR88792: 2
2026-03-29 18:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-29 18:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade2caca-3bbf-512f-962d-1cfe8490ba3a with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade2caca-3bbf-512f-962d-1cfe8490ba3a with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ade2caca-3bbf-512f-962d-1cfe8490ba3a, identifier: CR88792
2026-03-29 18:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-29 18:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-29 18:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792 to the API
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:09:01Z',
'fuel_type': 'petrol',
'id': 'ade2caca-3bbf-512f-962d-1cfe8490ba3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR88792',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 144392,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-22',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2016}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Saving data for CR88792: {'auction_closing_time': 1774883341.0, 'created_time': 1774607813.636578, 'last_price_update_time': 1774809919.568126}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR88792') HTTP/1.1" 204 0
2026-03-29 18:45:19 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-29 18:45:19 [auto1.de] INFO: Scrape type for CZ66164: 2
2026-03-29 18:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-29 18:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6925f432-851a-527b-9873-a8d4e5692c61 with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6925f432-851a-527b-9873-a8d4e5692c61 with scrape type 2
2026-03-29 18:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6925f432-851a-527b-9873-a8d4e5692c61, identifier: CZ66164
2026-03-29 18:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-29 18:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-29 18:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164 to the API
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:52:27Z',
'fuel_type': 'petrol',
'id': '6925f432-851a-527b-9873-a8d4e5692c61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ66164',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 78991,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2021}
2026-03-29 18:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Saving data for CZ66164: {'auction_closing_time': 1774885947.0, 'created_time': 1773858950.525664, 'last_price_update_time': 1774809920.002925}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ66164') HTTP/1.1" 204 0
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Scrape type for UB65858: 2
2026-03-29 18:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-29 18:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051, identifier: UB65858
2026-03-29 18:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-29 18:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-29 18:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858 to the API
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:28:39Z',
'fuel_type': 'petrol',
'id': '932b5149-bb5d-5fe5-8957-cb4cb7ab3051',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB65858',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 168406,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
'transmission': 'manual',
'trim': 'GTI BlueMotion Tech',
'year': 2013}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Saving data for UB65858: {'auction_closing_time': 1774884519.0, 'created_time': 1773303320.417177, 'last_price_update_time': 1774809920.466917}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB65858') HTTP/1.1" 204 0
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Scrape type for FU68975: 2
2026-03-29 18:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-29 18:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with scrape type 2
2026-03-29 18:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1, identifier: FU68975
2026-03-29 18:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-29 18:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-29 18:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975 to the API
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:57:32Z',
'fuel_type': 'diesel',
'id': 'cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU68975',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 243868,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-14',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Saving data for FU68975: {'auction_closing_time': 1774886252.0, 'created_time': 1773946014.772895, 'last_price_update_time': 1774809920.94555}
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU68975') HTTP/1.1" 204 0
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-29 18:45:20 [auto1.de] INFO: Scrape type for ZK53162: 0
2026-03-29 18:45:20 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-29 18:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Scrape type for EJ80176: 2
2026-03-29 18:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176
2026-03-29 18:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddcd894-e6e3-542b-9b84-bc71f5e88e66 with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dddcd894-e6e3-542b-9b84-bc71f5e88e66 with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dddcd894-e6e3-542b-9b84-bc71f5e88e66, identifier: EJ80176
2026-03-29 18:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176
2026-03-29 18:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176
2026-03-29 18:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dddcd894-e6e3-542b-9b84-bc71f5e88e66 with identifier: EJ80176 to the API
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 254,
'expiration_date': '2026-03-30T15:48:28Z',
'fuel_type': 'diesel',
'id': 'dddcd894-e6e3-542b-9b84-bc71f5e88e66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ80176',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-60',
'odometer': 3276,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-06-09',
'seller_name': None,
'title': 'Mazda CX-60 3.3 e-Skyactiv D Homura AWD',
'transmission': 'automatic',
'trim': 'Homura AWD',
'year': 2025}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Saving data for EJ80176: {'auction_closing_time': 1774885708.0, 'created_time': 1773303443.283726, 'last_price_update_time': 1774809921.416979}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ80176') HTTP/1.1" 204 0
2026-03-29 18:45:21 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-29 18:45:21 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Scrape type for VL77051: 2
2026-03-29 18:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051
2026-03-29 18:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae, identifier: VL77051
2026-03-29 18:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051
2026-03-29 18:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051
2026-03-29 18:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 040e6c9f-b5f2-58fe-a0ca-369eb5e284ae with identifier: VL77051 to the API
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:40Z',
'fuel_type': 'petrol',
'id': '040e6c9f-b5f2-58fe-a0ca-369eb5e284ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL77051',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 137948,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-26',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI ACT Highline BlueMotion',
'transmission': 'automatic',
'trim': 'Highline BlueMotion',
'year': 2015}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Saving data for VL77051: {'auction_closing_time': 1774884220.0, 'created_time': 1773916952.703523, 'last_price_update_time': 1774809921.920028}
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL77051') HTTP/1.1" 204 0
2026-03-29 18:45:21 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-29 18:45:21 [auto1.de] INFO: Scrape type for AN36712: 2
2026-03-29 18:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712
2026-03-29 18:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44976b6d-695f-5f60-9a88-d90fe983fbc7 with scrape type 2
2026-03-29 18:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44976b6d-695f-5f60-9a88-d90fe983fbc7 with scrape type 2
2026-03-29 18:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44976b6d-695f-5f60-9a88-d90fe983fbc7, identifier: AN36712
2026-03-29 18:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712
2026-03-29 18:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712
2026-03-29 18:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44976b6d-695f-5f60-9a88-d90fe983fbc7 with identifier: AN36712 to the API
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:22:57Z',
'fuel_type': 'petrol',
'id': '44976b6d-695f-5f60-9a88-d90fe983fbc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN36712',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 205122,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2013}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Saving data for AN36712: {'auction_closing_time': 1774884177.0, 'created_time': 1772544495.343027, 'last_price_update_time': 1774809922.353381}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN36712') HTTP/1.1" 204 0
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for SW09087: 0
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for KX34445: 0
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for FT81385: 0
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for VL67140: 0
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for SE09507: 0
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Scrape type for AM43166: 2
2026-03-29 18:45:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166
2026-03-29 18:45:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with scrape type 2
2026-03-29 18:45:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with scrape type 2
2026-03-29 18:45:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67, identifier: AM43166
2026-03-29 18:45:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166
2026-03-29 18:45:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166
2026-03-29 18:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67 with identifier: AM43166 to the API
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:14:31Z',
'fuel_type': 'petrol',
'id': '59e1d8ab-72d3-52c2-9ec9-c47ea1a52e67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM43166',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 167177,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-14',
'seller_name': None,
'title': 'Dacia Logan MCV 0.9 TCe Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2016}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-29 18:45:22 [auto1.de] INFO: Saving data for AM43166: {'auction_closing_time': 1774883671.0, 'created_time': 1773917564.123621, 'last_price_update_time': 1774809922.865604}
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM43166') HTTP/1.1" 204 0
2026-03-29 18:45:22 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:22 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-29 18:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for ZY93547: 2
2026-03-29 18:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-29 18:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb, identifier: ZY93547
2026-03-29 18:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-29 18:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-29 18:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547 to the API
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:51Z',
'fuel_type': 'petrol',
'id': '3ae146cf-7f04-5b2e-b308-fd145b35ddfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY93547',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 59267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-03',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2021}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Saving data for ZY93547: {'auction_closing_time': 1774883211.0, 'created_time': 1773830309.988095, 'last_price_update_time': 1774809923.473307}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY93547') HTTP/1.1" 204 0
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for CP27370: 0
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for HZ93598: 0
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for UK49641: 2
2026-03-29 18:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641
2026-03-29 18:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 702ee690-810c-5b40-bcf6-a06575739c8e with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 702ee690-810c-5b40-bcf6-a06575739c8e with scrape type 2
2026-03-29 18:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 702ee690-810c-5b40-bcf6-a06575739c8e, identifier: UK49641
2026-03-29 18:45:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for MX59150: 0
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Scrape type for BH54290: 0
2026-03-29 18:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641
2026-03-29 18:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641
2026-03-29 18:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 702ee690-810c-5b40-bcf6-a06575739c8e with identifier: UK49641 to the API
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:49:22Z',
'fuel_type': 'diesel',
'id': '702ee690-810c-5b40-bcf6-a06575739c8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK49641',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 74386,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-16',
'seller_name': None,
'title': 'Audi A5 Sportback 40 TDI Mild-Hybrid quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2021}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-29 18:45:23 [auto1.de] INFO: Saving data for UK49641: {'auction_closing_time': 1774885762.0, 'created_time': 1773307894.912403, 'last_price_update_time': 1774809923.969289}
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK49641') HTTP/1.1" 204 0
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-29 18:45:23 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-29 18:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Scrape type for DL82245: 0
2026-03-29 18:45:24 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Scrape type for WT01639: 0
2026-03-29 18:45:24 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Scrape type for UG67799: 2
2026-03-29 18:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-29 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a09ef76-c396-5292-8f73-c549689bd410 with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a09ef76-c396-5292-8f73-c549689bd410 with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a09ef76-c396-5292-8f73-c549689bd410, identifier: UG67799
2026-03-29 18:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-29 18:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-29 18:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799 to the API
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:24:00Z',
'fuel_type': 'petrol',
'id': '6a09ef76-c396-5292-8f73-c549689bd410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG67799',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 135663,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-03',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2011}
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Saving data for UG67799: {'auction_closing_time': 1774884240.0, 'created_time': 1774293382.272049, 'last_price_update_time': 1774809924.503294}
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG67799') HTTP/1.1" 204 0
2026-03-29 18:45:24 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-29 18:45:24 [auto1.de] INFO: Scrape type for WF94997: 2
2026-03-29 18:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-29 18:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73659620-789d-5430-ac35-bd3f82392bfb with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73659620-789d-5430-ac35-bd3f82392bfb with scrape type 2
2026-03-29 18:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73659620-789d-5430-ac35-bd3f82392bfb, identifier: WF94997
2026-03-29 18:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-29 18:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-29 18:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997 to the API
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:34Z',
'fuel_type': 'petrol',
'id': '73659620-789d-5430-ac35-bd3f82392bfb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF94997',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 221038,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-07',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI ACT Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2018}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Saving data for WF94997: {'auction_closing_time': 1774882834.0, 'created_time': 1773307720.280905, 'last_price_update_time': 1774809925.07572}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF94997') HTTP/1.1" 204 0
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Scrape type for CW65482: 0
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: US61717
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Scrape type for US61717: 0
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Scrape type for MU16772: 0
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Scrape type for YF55621: 2
2026-03-29 18:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-29 18:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d21c6585-5bb0-5522-8d5c-8a39cd5aa874, identifier: YF55621
2026-03-29 18:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-29 18:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-29 18:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621 to the API
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:05:59Z',
'fuel_type': 'diesel',
'id': 'd21c6585-5bb0-5522-8d5c-8a39cd5aa874',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF55621',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 119211,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-28',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Saving data for YF55621: {'auction_closing_time': 1774883159.0, 'created_time': 1774294670.597503, 'last_price_update_time': 1774809925.621801}
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF55621') HTTP/1.1" 204 0
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-29 18:45:25 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-29 18:45:25 [auto1.de] INFO: Scrape type for JV63052: 2
2026-03-29 18:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-29 18:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with scrape type 2
2026-03-29 18:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2775f533-8a1d-568a-9f06-dabd22d7b9b8, identifier: JV63052
2026-03-29 18:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-29 18:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-29 18:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052 to the API
2026-03-29 18:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:37:37Z',
'fuel_type': 'hybrid',
'id': '2775f533-8a1d-568a-9f06-dabd22d7b9b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV63052',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 109185,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-27',
'seller_name': None,
'title': 'Skoda Superb 1.4 Plug-in Hybrid Sportline iV',
'transmission': 'automatic',
'trim': 'Sportline iV',
'year': 2021}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Saving data for JV63052: {'auction_closing_time': 1774885057.0, 'created_time': 1773304030.229244, 'last_price_update_time': 1774809927.274748}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV63052') HTTP/1.1" 204 0
2026-03-29 18:45:27 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Scrape type for UE48673: 0
2026-03-29 18:45:27 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-29 18:45:27 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Scrape type for WE87101: 2
2026-03-29 18:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-29 18:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed, identifier: WE87101
2026-03-29 18:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-29 18:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-29 18:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101 to the API
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:17Z',
'fuel_type': 'diesel',
'id': '75645dd4-8e13-5fc9-af5e-123ac71bf0ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE87101',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 213012,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-25',
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Saving data for WE87101: {'auction_closing_time': 1774883057.0, 'created_time': 1773305537.484248, 'last_price_update_time': 1774809927.728946}
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE87101') HTTP/1.1" 204 0
2026-03-29 18:45:27 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-29 18:45:27 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-29 18:45:27 [auto1.de] INFO: Scrape type for SG14649: 2
2026-03-29 18:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649
2026-03-29 18:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b2c05b-b02c-5847-a0ba-f8538e30e573 with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52b2c05b-b02c-5847-a0ba-f8538e30e573 with scrape type 2
2026-03-29 18:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52b2c05b-b02c-5847-a0ba-f8538e30e573, identifier: SG14649
2026-03-29 18:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649
2026-03-29 18:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649
2026-03-29 18:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52b2c05b-b02c-5847-a0ba-f8538e30e573 with identifier: SG14649 to the API
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 69,
'expiration_date': '2026-03-30T15:51:29Z',
'fuel_type': 'petrol',
'id': '52b2c05b-b02c-5847-a0ba-f8538e30e573',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG14649',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 7162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-14',
'seller_name': None,
'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
'transmission': 'manual',
'trim': 'Dolcevita',
'year': 2022}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Saving data for SG14649: {'auction_closing_time': 1774885889.0, 'created_time': 1774034842.291632, 'last_price_update_time': 1774809928.247986}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG14649') HTTP/1.1" 204 0
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Scrape type for AM79611: 0
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Scrape type for JE71066: 2
2026-03-29 18:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-29 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94e624af-c21c-53bb-9b98-00e2082c8152 with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94e624af-c21c-53bb-9b98-00e2082c8152 with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94e624af-c21c-53bb-9b98-00e2082c8152, identifier: JE71066
2026-03-29 18:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-29 18:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-29 18:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066 to the API
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 215,
'expiration_date': '2026-03-30T15:22:48Z',
'fuel_type': 'diesel',
'id': '94e624af-c21c-53bb-9b98-00e2082c8152',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE71066',
'listing': 'auction',
'make': 'Volvo',
'model': 'S60',
'odometer': 199158,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-17',
'seller_name': None,
'title': 'Volvo S60 2.4 D5 AWD',
'transmission': 'automatic',
'trim': 'AWD',
'year': 2011}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Saving data for JE71066: {'auction_closing_time': 1774884168.0, 'created_time': 1774330542.272959, 'last_price_update_time': 1774809928.68193}
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE71066') HTTP/1.1" 204 0
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Scrape type for HW43883: 0
2026-03-29 18:45:28 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-29 18:45:28 [auto1.de] INFO: Scrape type for DV40482: 2
2026-03-29 18:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-29 18:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b33532ed-a453-51fc-9477-ddf7a51c9373 with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b33532ed-a453-51fc-9477-ddf7a51c9373 with scrape type 2
2026-03-29 18:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b33532ed-a453-51fc-9477-ddf7a51c9373, identifier: DV40482
2026-03-29 18:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-29 18:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482
2026-03-29 18:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b33532ed-a453-51fc-9477-ddf7a51c9373 with identifier: DV40482 to the API
2026-03-29 18:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:53:19Z',
'fuel_type': 'petrol',
'id': 'b33532ed-a453-51fc-9477-ddf7a51c9373',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV40482',
'listing': 'auction',
'make': 'Peugeot',
'model': '407',
'odometer': 168257,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-30',
'seller_name': None,
'title': 'Peugeot 407 2.0 Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2005}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Saving data for DV40482: {'auction_closing_time': 1774885999.0, 'created_time': 1774033885.275249, 'last_price_update_time': 1774809929.142516}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV40482') HTTP/1.1" 204 0
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Scrape type for JX17185: 2
2026-03-29 18:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-29 18:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef360b7-994a-5ac5-bf57-42ec01862ff9 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef360b7-994a-5ac5-bf57-42ec01862ff9 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bef360b7-994a-5ac5-bf57-42ec01862ff9, identifier: JX17185
2026-03-29 18:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-29 18:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-29 18:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185 to the API
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:56:12Z',
'fuel_type': 'petrol',
'id': 'bef360b7-994a-5ac5-bf57-42ec01862ff9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX17185',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 24281,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-20',
'seller_name': None,
'title': 'BMW X1 sDrive 18i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2017}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Saving data for JX17185: {'auction_closing_time': 1774886172.0, 'created_time': 1774607849.46068, 'last_price_update_time': 1774809929.6517}
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX17185') HTTP/1.1" 204 0
2026-03-29 18:45:29 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-29 18:45:29 [auto1.de] INFO: Scrape type for EK35927: 2
2026-03-29 18:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-29 18:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with scrape type 2
2026-03-29 18:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5, identifier: EK35927
2026-03-29 18:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-29 18:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-29 18:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927 to the API
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:52:54Z',
'fuel_type': 'petrol',
'id': '88f5dc3d-7c0f-5c73-b99d-0c418ac358e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK35927',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 139354,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-18',
'seller_name': None,
'title': 'Seat Ibiza 1.4 Best of',
'transmission': 'manual',
'trim': 'Best of',
'year': 2008}
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-29 18:45:30 [auto1.de] INFO: Saving data for EK35927: {'auction_closing_time': 1774885974.0, 'created_time': 1774608612.503727, 'last_price_update_time': 1774809930.102126}
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK35927') HTTP/1.1" 204 0
2026-03-29 18:45:30 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-29 18:45:30 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-29 18:45:30 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-29 18:45:30 [auto1.de] INFO: Scrape type for BH17233: 0
2026-03-29 18:45:30 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-29 18:45:30 [auto1.de] INFO: Scrape type for ZC42699: 2
2026-03-29 18:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-29 18:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acbb90e9-eade-513d-8eb4-35cf6804cc04 with scrape type 2
2026-03-29 18:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acbb90e9-eade-513d-8eb4-35cf6804cc04 with scrape type 2
2026-03-29 18:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acbb90e9-eade-513d-8eb4-35cf6804cc04, identifier: ZC42699
2026-03-29 18:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-29 18:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699
2026-03-29 18:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acbb90e9-eade-513d-8eb4-35cf6804cc04 with identifier: ZC42699 to the API
2026-03-29 18:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 440,
'expiration_date': '2026-03-30T15:48:10Z',
'fuel_type': 'petrol',
'id': 'acbb90e9-eade-513d-8eb4-35cf6804cc04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC42699',
'listing': 'auction',
'make': 'Porsche',
'model': 'Panamera Sport Turismo',
'odometer': 134297,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-12',
'seller_name': None,
'title': 'Porsche Panamera Sport Turismo 4S',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-29 18:45:31 [auto1.de] INFO: Saving data for ZC42699: {'auction_closing_time': 1774885690.0, 'created_time': 1774522119.593599, 'last_price_update_time': 1774809931.484104}
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC42699') HTTP/1.1" 204 0
2026-03-29 18:45:31 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-29 18:45:31 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-29 18:45:31 [auto1.de] INFO: Scrape type for TB42941: 2
2026-03-29 18:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-29 18:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e63e799-a946-5728-ab08-7b19f10afa1f with scrape type 2
2026-03-29 18:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e63e799-a946-5728-ab08-7b19f10afa1f with scrape type 2
2026-03-29 18:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e63e799-a946-5728-ab08-7b19f10afa1f, identifier: TB42941
2026-03-29 18:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-29 18:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941
2026-03-29 18:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e63e799-a946-5728-ab08-7b19f10afa1f with identifier: TB42941 to the API
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:43:04Z',
'fuel_type': 'petrol',
'id': '4e63e799-a946-5728-ab08-7b19f10afa1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB42941',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 30143,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-12',
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2023}
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-29 18:45:31 [auto1.de] INFO: Saving data for TB42941: {'auction_closing_time': 1774885384.0, 'created_time': 1774521555.50864, 'last_price_update_time': 1774809931.977081}
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB42941') HTTP/1.1" 204 0
2026-03-29 18:45:31 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Scrape type for HU37680: 0
2026-03-29 18:45:32 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Scrape type for DM49539: 2
2026-03-29 18:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-29 18:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e482be7a-5a9d-5107-be5f-6d26aa03110a with scrape type 2
2026-03-29 18:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e482be7a-5a9d-5107-be5f-6d26aa03110a with scrape type 2
2026-03-29 18:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e482be7a-5a9d-5107-be5f-6d26aa03110a, identifier: DM49539
2026-03-29 18:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-29 18:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-29 18:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539 to the API
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:58:34Z',
'fuel_type': 'petrol',
'id': 'e482be7a-5a9d-5107-be5f-6d26aa03110a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM49539',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 174379,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-30',
'seller_name': None,
'title': 'Honda Civic 1.8 i-VTEC Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2014}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Saving data for DM49539: {'auction_closing_time': 1774886314.0, 'created_time': 1774291496.620035, 'last_price_update_time': 1774809932.497889}
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM49539') HTTP/1.1" 204 0
2026-03-29 18:45:32 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-29 18:45:32 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-29 18:45:32 [auto1.de] INFO: Scrape type for ZU82600: 0
2026-03-29 18:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:36 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:36 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-29 18:45:36 [auto1.de] INFO: Scrape type for XG24427: 2
2026-03-29 18:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-29 18:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa with scrape type 2
2026-03-29 18:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa with scrape type 2
2026-03-29 18:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3aea76f-6bbe-50f5-b2e0-c358667c15fa, identifier: XG24427
2026-03-29 18:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-29 18:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-29 18:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427 to the API
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:38:47Z',
'fuel_type': 'diesel',
'id': 'd3aea76f-6bbe-50f5-b2e0-c358667c15fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG24427',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 251784,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-20',
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Saving data for XG24427: {'auction_closing_time': 1774885127.0, 'created_time': 1774608166.312778, 'last_price_update_time': 1774809937.246017}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG24427') HTTP/1.1" 204 0
2026-03-29 18:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Scrape type for AE19293: 2
2026-03-29 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-29 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56, identifier: AE19293
2026-03-29 18:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-29 18:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-29 18:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293 to the API
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:39:51Z',
'fuel_type': 'diesel',
'id': '24cdf4b6-0ff2-50c4-9ff7-b88c84864b56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE19293',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 59267,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-04',
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2021}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Saving data for AE19293: {'auction_closing_time': 1774885191.0, 'created_time': 1773303958.611126, 'last_price_update_time': 1774809937.718988}
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE19293') HTTP/1.1" 204 0
2026-03-29 18:45:37 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-29 18:45:37 [auto1.de] INFO: Scrape type for NF75522: 2
2026-03-29 18:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-29 18:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3238025c-6061-5233-9191-0baaae62f2c3 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3238025c-6061-5233-9191-0baaae62f2c3 with scrape type 2
2026-03-29 18:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3238025c-6061-5233-9191-0baaae62f2c3, identifier: NF75522
2026-03-29 18:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-29 18:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-29 18:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522 to the API
2026-03-29 18:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:29:16Z',
'fuel_type': 'diesel',
'id': '3238025c-6061-5233-9191-0baaae62f2c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF75522',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 72616,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-24',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2019}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Saving data for NF75522: {'auction_closing_time': 1774884556.0, 'created_time': 1774264606.462797, 'last_price_update_time': 1774809938.174965}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF75522') HTTP/1.1" 204 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for VK80269: 2
2026-03-29 18:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-29 18:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a5f268-9849-5d95-814b-4a03d612efc5 with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a5f268-9849-5d95-814b-4a03d612efc5 with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0a5f268-9849-5d95-814b-4a03d612efc5, identifier: VK80269
2026-03-29 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-29 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269
2026-03-29 18:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0a5f268-9849-5d95-814b-4a03d612efc5 with identifier: VK80269 to the API
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:58:22Z',
'fuel_type': 'diesel',
'id': 'a0a5f268-9849-5d95-814b-4a03d612efc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK80269',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 125401,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-22',
'seller_name': None,
'title': 'BMW 3er 320d xDrive M Sport Shadow',
'transmission': 'automatic',
'trim': 'xDrive M Sport Shadow',
'year': 2018}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Saving data for VK80269: {'auction_closing_time': 1774886302.0, 'created_time': 1774521732.587345, 'last_price_update_time': 1774809938.598846}
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK80269') HTTP/1.1" 204 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for BP61239: 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for WY85656: 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for DS59487: 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for BZ01431: 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for HE00518: 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for AV69297: 0
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-29 18:45:38 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-29 18:45:38 [auto1.de] INFO: Scrape type for WP15063: 2
2026-03-29 18:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-29 18:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ac52a7-84a1-5052-94a9-288b655f7ab4 with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ac52a7-84a1-5052-94a9-288b655f7ab4 with scrape type 2
2026-03-29 18:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6ac52a7-84a1-5052-94a9-288b655f7ab4, identifier: WP15063
2026-03-29 18:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-29 18:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-29 18:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063 to the API
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:41:42Z',
'fuel_type': 'petrol',
'id': 'b6ac52a7-84a1-5052-94a9-288b655f7ab4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP15063',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 144777,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-10-06',
'seller_name': None,
'title': 'Ford Focus 1.6 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2005}
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Saving data for WP15063: {'auction_closing_time': 1774885302.0, 'created_time': 1774263787.076058, 'last_price_update_time': 1774809939.270734}
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP15063') HTTP/1.1" 204 0
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Scrape type for LA57205: 0
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Scrape type for KR84974: 0
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Scrape type for EB43981: 0
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Scrape type for FM24732: 0
2026-03-29 18:45:39 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-29 18:45:39 [auto1.de] INFO: Scrape type for WE30814: 0
2026-03-29 18:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:40 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:40 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-29 18:45:40 [auto1.de] INFO: Scrape type for MS46414: 2
2026-03-29 18:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-29 18:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 503f72bb-64fa-5a0d-b94d-40863b41395d with scrape type 2
2026-03-29 18:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 503f72bb-64fa-5a0d-b94d-40863b41395d with scrape type 2
2026-03-29 18:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 503f72bb-64fa-5a0d-b94d-40863b41395d, identifier: MS46414
2026-03-29 18:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-29 18:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-29 18:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414 to the API
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:49Z',
'fuel_type': 'diesel',
'id': '503f72bb-64fa-5a0d-b94d-40863b41395d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS46414',
'listing': 'auction',
'make': 'Volvo',
'model': 'C30',
'odometer': 106636,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-30',
'seller_name': None,
'title': 'Volvo C30 1.6 D Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2007}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-29 18:45:40 [auto1.de] INFO: Saving data for MS46414: {'auction_closing_time': 1774883329.0, 'created_time': 1772544816.353118, 'last_price_update_time': 1774809940.867277}
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS46414') HTTP/1.1" 204 0
2026-03-29 18:45:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:40 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-29 18:45:40 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-29 18:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for DD09602: 2
2026-03-29 18:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-29 18:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b34d1d-206d-54dc-9a84-cc44e958c5eb with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b34d1d-206d-54dc-9a84-cc44e958c5eb with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6b34d1d-206d-54dc-9a84-cc44e958c5eb, identifier: DD09602
2026-03-29 18:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-29 18:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-29 18:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602 to the API
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:42:06Z',
'fuel_type': 'diesel',
'id': 'f6b34d1d-206d-54dc-9a84-cc44e958c5eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD09602',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 171680,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-05',
'seller_name': None,
'title': 'Opel Zafira Tourer 2.0 CDTI Drive',
'transmission': 'manual',
'trim': 'Drive',
'year': 2015}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Saving data for DD09602: {'auction_closing_time': 1774885326.0, 'created_time': 1774294105.08387, 'last_price_update_time': 1774809941.438845}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD09602') HTTP/1.1" 204 0
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for SB14031: 0
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for RT09261: 0
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07171%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for NC07171: 0
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for XC86569: 0
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for HW02228: 0
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-29 18:45:41 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Scrape type for ST04128: 2
2026-03-29 18:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128
2026-03-29 18:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcbf6e82-7c84-5d17-933a-5150149904c6 with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcbf6e82-7c84-5d17-933a-5150149904c6 with scrape type 2
2026-03-29 18:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcbf6e82-7c84-5d17-933a-5150149904c6, identifier: ST04128
2026-03-29 18:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128
2026-03-29 18:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128
2026-03-29 18:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcbf6e82-7c84-5d17-933a-5150149904c6 with identifier: ST04128 to the API
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:30:31Z',
'fuel_type': 'petrol',
'id': 'bcbf6e82-7c84-5d17-933a-5150149904c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST04128',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 171498,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-27',
'seller_name': None,
'title': 'Nissan Micra 1.0 DIG-T N-Sport',
'transmission': 'manual',
'trim': 'N-Sport',
'year': 2019}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-29 18:45:41 [auto1.de] INFO: Saving data for ST04128: {'auction_closing_time': 1774884631.0, 'created_time': 1774636648.043653, 'last_price_update_time': 1774809941.953355}
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST04128') HTTP/1.1" 204 0
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-29 18:45:42 [auto1.de] INFO: Scrape type for KW68340: 2
2026-03-29 18:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-29 18:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86, identifier: KW68340
2026-03-29 18:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-29 18:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340
2026-03-29 18:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f4acaef-f5e5-589e-bd99-a729fe0f1b86 with identifier: KW68340 to the API
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:40:39Z',
'fuel_type': 'diesel',
'id': '3f4acaef-f5e5-589e-bd99-a729fe0f1b86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW68340',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 131624,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-27',
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-29 18:45:42 [auto1.de] INFO: Saving data for KW68340: {'auction_closing_time': 1774885239.0, 'created_time': 1773427052.657912, 'last_price_update_time': 1774809942.481008}
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW68340') HTTP/1.1" 204 0
2026-03-29 18:45:42 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-29 18:45:42 [auto1.de] INFO: Scrape type for PD01129: 2
2026-03-29 18:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-29 18:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364104c5-2621-520a-b0b0-e2269758fae5 with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 364104c5-2621-520a-b0b0-e2269758fae5 with scrape type 2
2026-03-29 18:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 364104c5-2621-520a-b0b0-e2269758fae5, identifier: PD01129
2026-03-29 18:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-29 18:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-29 18:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129 to the API
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:39:17Z',
'fuel_type': 'diesel',
'id': '364104c5-2621-520a-b0b0-e2269758fae5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD01129',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 215400,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-04',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Ambition',
'transmission': 'automatic',
'trim': 'quattro Ambition',
'year': 2015}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Saving data for PD01129: {'auction_closing_time': 1774885157.0, 'created_time': 1774293468.080514, 'last_price_update_time': 1774809943.012191}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD01129') HTTP/1.1" 204 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for UB61823: 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for GR15033: 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for DW69161: 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for JK09354: 2
2026-03-29 18:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-29 18:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c2a8801-2849-5b91-9ca2-812afe0accf1 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c2a8801-2849-5b91-9ca2-812afe0accf1 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c2a8801-2849-5b91-9ca2-812afe0accf1, identifier: JK09354
2026-03-29 18:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-29 18:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-29 18:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354 to the API
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:23Z',
'fuel_type': 'diesel',
'id': '5c2a8801-2849-5b91-9ca2-812afe0accf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK09354',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 119096,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-14',
'seller_name': None,
'title': 'Audi A4 35 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Saving data for JK09354: {'auction_closing_time': 1774884623.0, 'created_time': 1773308000.018424, 'last_price_update_time': 1774809943.583007}
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK09354') HTTP/1.1" 204 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for UE92744: 0
2026-03-29 18:45:43 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-29 18:45:43 [auto1.de] INFO: Scrape type for BX45513: 2
2026-03-29 18:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513
2026-03-29 18:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with scrape type 2
2026-03-29 18:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d70e638b-c6c0-57e1-a0ef-c6a162050ad7, identifier: BX45513
2026-03-29 18:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513
2026-03-29 18:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513
2026-03-29 18:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d70e638b-c6c0-57e1-a0ef-c6a162050ad7 with identifier: BX45513 to the API
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:43:16Z',
'fuel_type': 'diesel',
'id': 'd70e638b-c6c0-57e1-a0ef-c6a162050ad7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX45513',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 56080,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-07',
'seller_name': None,
'title': 'Volkswagen T-Cross 1.6 TDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Saving data for BX45513: {'auction_closing_time': 1774885396.0, 'created_time': 1773946811.769795, 'last_price_update_time': 1774809944.10413}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX45513') HTTP/1.1" 204 0
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Scrape type for VH92759: 2
2026-03-29 18:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759
2026-03-29 18:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 158a8643-5b2f-56bf-aaa7-07d4e101d112 with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 158a8643-5b2f-56bf-aaa7-07d4e101d112 with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 158a8643-5b2f-56bf-aaa7-07d4e101d112, identifier: VH92759
2026-03-29 18:45:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759
2026-03-29 18:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759
2026-03-29 18:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 158a8643-5b2f-56bf-aaa7-07d4e101d112 with identifier: VH92759 to the API
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:40:28Z',
'fuel_type': 'petrol',
'id': '158a8643-5b2f-56bf-aaa7-07d4e101d112',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH92759',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 152928,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-16',
'seller_name': None,
'title': 'Audi Q3 2.0 TFSI quattro',
'transmission': 'manual',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Saving data for VH92759: {'auction_closing_time': 1774885228.0, 'created_time': 1773131851.853362, 'last_price_update_time': 1774809944.539653}
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH92759') HTTP/1.1" 204 0
2026-03-29 18:45:44 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-29 18:45:44 [auto1.de] INFO: Scrape type for UH05961: 2
2026-03-29 18:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-29 18:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef7df37-4800-551f-9796-4fcf1b2fa79f with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef7df37-4800-551f-9796-4fcf1b2fa79f with scrape type 2
2026-03-29 18:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fef7df37-4800-551f-9796-4fcf1b2fa79f, identifier: UH05961
2026-03-29 18:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-29 18:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-29 18:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961 to the API
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:29:10Z',
'fuel_type': 'diesel',
'id': 'fef7df37-4800-551f-9796-4fcf1b2fa79f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH05961',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 178237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-15',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Clever',
'transmission': 'automatic',
'trim': 'Clever',
'year': 2018}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Saving data for UH05961: {'auction_closing_time': 1774884550.0, 'created_time': 1773772561.125417, 'last_price_update_time': 1774809945.045939}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH05961') HTTP/1.1" 204 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for SX50197: 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-29 18:45:45 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for MB99639: 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for XF93739: 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for MT56584: 2
2026-03-29 18:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-29 18:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 056e708f-fade-5e36-a291-087ac51a274b with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 056e708f-fade-5e36-a291-087ac51a274b with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 056e708f-fade-5e36-a291-087ac51a274b, identifier: MT56584
2026-03-29 18:45:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-29 18:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-29 18:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584 to the API
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:12:13Z',
'fuel_type': 'petrol',
'id': '056e708f-fade-5e36-a291-087ac51a274b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT56584',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 155013,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-13',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Monte Carlo',
'transmission': 'manual',
'trim': 'Monte Carlo',
'year': 2013}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Saving data for MT56584: {'auction_closing_time': 1774883533.0, 'created_time': 1774293430.642372, 'last_price_update_time': 1774809945.596438}
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT56584') HTTP/1.1" 204 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for XJ30357: 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for FB48782: 0
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-29 18:45:45 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-29 18:45:45 [auto1.de] INFO: Scrape type for JY20975: 2
2026-03-29 18:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-29 18:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with scrape type 2
2026-03-29 18:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b99ce715-5408-51fb-a5dc-b1e12bba4dd9, identifier: JY20975
2026-03-29 18:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-29 18:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-29 18:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975 to the API
2026-03-29 18:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:37Z',
'fuel_type': 'petrol',
'id': 'b99ce715-5408-51fb-a5dc-b1e12bba4dd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY20975',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 31538,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-21',
'seller_name': None,
'title': 'Seat Tarraco 1.5 TSI ACT FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2023}
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Saving data for JY20975: {'auction_closing_time': 1774883017.0, 'created_time': 1774264193.656289, 'last_price_update_time': 1774809946.276895}
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY20975') HTTP/1.1" 204 0
2026-03-29 18:45:46 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Scrape type for VA13792: 0
2026-03-29 18:45:46 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Scrape type for CM58161: 2
2026-03-29 18:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161
2026-03-29 18:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc91ac1-39ae-586c-8f03-e99fba943819 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc91ac1-39ae-586c-8f03-e99fba943819 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bc91ac1-39ae-586c-8f03-e99fba943819, identifier: CM58161
2026-03-29 18:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161
2026-03-29 18:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161
2026-03-29 18:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bc91ac1-39ae-586c-8f03-e99fba943819 with identifier: CM58161 to the API
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:55:30Z',
'fuel_type': 'petrol',
'id': '2bc91ac1-39ae-586c-8f03-e99fba943819',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM58161',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 274311,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-12',
'seller_name': None,
'title': 'Volkswagen Touran 1.4 TSI Highline',
'transmission': 'automatic',
'trim': 'Highline',
'year': 2008}
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Saving data for CM58161: {'auction_closing_time': 1774886130.0, 'created_time': 1773383550.360662, 'last_price_update_time': 1774809946.700919}
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM58161') HTTP/1.1" 204 0
2026-03-29 18:45:46 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-29 18:45:46 [auto1.de] INFO: Scrape type for SP67485: 2
2026-03-29 18:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-29 18:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45631848-20ed-5365-8783-d18efe639f58 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45631848-20ed-5365-8783-d18efe639f58 with scrape type 2
2026-03-29 18:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45631848-20ed-5365-8783-d18efe639f58, identifier: SP67485
2026-03-29 18:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-29 18:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-29 18:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485 to the API
2026-03-29 18:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:49:54Z',
'fuel_type': 'diesel',
'id': '45631848-20ed-5365-8783-d18efe639f58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP67485',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 196606,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-28',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2008}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Saving data for SP67485: {'auction_closing_time': 1774885794.0, 'created_time': 1773301971.904257, 'last_price_update_time': 1774809947.206818}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP67485') HTTP/1.1" 204 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for BC52904: 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for JU59461: 2
2026-03-29 18:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-29 18:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c5fe71-8c07-56e2-8f58-968243bff05b with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3c5fe71-8c07-56e2-8f58-968243bff05b with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3c5fe71-8c07-56e2-8f58-968243bff05b, identifier: JU59461
2026-03-29 18:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-29 18:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-29 18:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461 to the API
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:48:51Z',
'fuel_type': 'petrol',
'id': 'd3c5fe71-8c07-56e2-8f58-968243bff05b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU59461',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 68105,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-28',
'seller_name': None,
'title': 'MINI Cooper Classic Trim',
'transmission': 'automatic',
'trim': 'Classic Trim',
'year': 2021}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Saving data for JU59461: {'auction_closing_time': 1774885731.0, 'created_time': 1773306705.259039, 'last_price_update_time': 1774809947.77352}
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU59461') HTTP/1.1" 204 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for HX55522: 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for YC54043: 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for YF47459: 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for TS98939: 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for NV91199: 0
2026-03-29 18:45:47 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-29 18:45:47 [auto1.de] INFO: Scrape type for YY76457: 2
2026-03-29 18:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-29 18:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with scrape type 2
2026-03-29 18:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb6b7c9e-2962-5a4f-8022-7a697f5711f9, identifier: YY76457
2026-03-29 18:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-29 18:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-29 18:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457 to the API
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:26:26Z',
'fuel_type': 'petrol',
'id': 'eb6b7c9e-2962-5a4f-8022-7a697f5711f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY76457',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 110081,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-23',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Saving data for YY76457: {'auction_closing_time': 1774884386.0, 'created_time': 1773687981.50687, 'last_price_update_time': 1774809948.329537}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY76457') HTTP/1.1" 204 0
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Scrape type for RZ49473: 0
2026-03-29 18:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:48 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-29 18:45:48 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Scrape type for JM16548: 2
2026-03-29 18:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-29 18:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8049887e-e6ec-5ec0-b934-32ee67f4586a with scrape type 2
2026-03-29 18:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8049887e-e6ec-5ec0-b934-32ee67f4586a with scrape type 2
2026-03-29 18:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8049887e-e6ec-5ec0-b934-32ee67f4586a, identifier: JM16548
2026-03-29 18:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-29 18:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-29 18:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548 to the API
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:37:40Z',
'fuel_type': 'petrol',
'id': '8049887e-e6ec-5ec0-b934-32ee67f4586a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM16548',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 119026,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-28',
'seller_name': None,
'title': 'Toyota Yaris 1.33 Dual VVT-i Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2009}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-29 18:45:48 [auto1.de] INFO: Saving data for JM16548: {'auction_closing_time': 1774885060.0, 'created_time': 1774608349.382555, 'last_price_update_time': 1774809948.988803}
2026-03-29 18:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM16548') HTTP/1.1" 204 0
2026-03-29 18:45:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Scrape type for SZ94185: 0
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Scrape type for EA80690: 2
2026-03-29 18:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-29 18:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fb6605-c81f-5419-ba64-705d43223fb1 with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4fb6605-c81f-5419-ba64-705d43223fb1 with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4fb6605-c81f-5419-ba64-705d43223fb1, identifier: EA80690
2026-03-29 18:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-29 18:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-29 18:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690 to the API
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:28:37Z',
'fuel_type': 'gas',
'id': 'e4fb6605-c81f-5419-ba64-705d43223fb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA80690',
'listing': 'auction',
'make': 'Dacia',
'model': 'Jogger',
'odometer': 42366,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-13',
'seller_name': None,
'title': 'Dacia Jogger 1.0 TCe LPG Extreme+',
'transmission': 'manual',
'trim': 'Extreme+',
'year': 2023}
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Saving data for EA80690: {'auction_closing_time': 1774884517.0, 'created_time': 1774608267.898325, 'last_price_update_time': 1774809949.472471}
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA80690') HTTP/1.1" 204 0
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Scrape type for WN68055: 0
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Scrape type for HE65946: 0
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-29 18:45:49 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-29 18:45:49 [auto1.de] INFO: Scrape type for ZW60338: 2
2026-03-29 18:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-29 18:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6761bb1-61f1-5615-ba88-c15d724142ed with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6761bb1-61f1-5615-ba88-c15d724142ed with scrape type 2
2026-03-29 18:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6761bb1-61f1-5615-ba88-c15d724142ed, identifier: ZW60338
2026-03-29 18:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-29 18:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338
2026-03-29 18:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6761bb1-61f1-5615-ba88-c15d724142ed with identifier: ZW60338 to the API
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:11:30Z',
'fuel_type': 'petrol',
'id': 'f6761bb1-61f1-5615-ba88-c15d724142ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW60338',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 162693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-29',
'seller_name': None,
'title': 'Opel Insignia 2.0 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2010}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Saving data for ZW60338: {'auction_closing_time': 1774883490.0, 'created_time': 1774522151.260255, 'last_price_update_time': 1774809950.015651}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW60338') HTTP/1.1" 204 0
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for PX99081: 0
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for MX11435: 0
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for YJ21289: 2
2026-03-29 18:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-29 18:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d, identifier: YJ21289
2026-03-29 18:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-29 18:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289
2026-03-29 18:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78c6cb8d-c293-525b-9df6-2e4ef86ba37d with identifier: YJ21289 to the API
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:45:20Z',
'fuel_type': 'petrol',
'id': '78c6cb8d-c293-525b-9df6-2e4ef86ba37d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ21289',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 66791,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-29',
'seller_name': None,
'title': 'Audi A5 45 TFSI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Saving data for YJ21289: {'auction_closing_time': 1774885520.0, 'created_time': 1773382195.103127, 'last_price_update_time': 1774809950.495558}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ21289') HTTP/1.1" 204 0
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for EN65963: 0
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-29 18:45:50 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Scrape type for GY78752: 2
2026-03-29 18:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-29 18:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with scrape type 2
2026-03-29 18:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe, identifier: GY78752
2026-03-29 18:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-29 18:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-29 18:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752 to the API
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:26:46Z',
'fuel_type': 'diesel',
'id': '499baf1a-a7ea-5fb3-bc3f-9a390b546ffe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY78752',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 268358,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-14',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2005}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-29 18:45:50 [auto1.de] INFO: Saving data for GY78752: {'auction_closing_time': 1774884406.0, 'created_time': 1773859002.832086, 'last_price_update_time': 1774809950.943732}
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY78752') HTTP/1.1" 204 0
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Scrape type for VU36237: 2
2026-03-29 18:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237
2026-03-29 18:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1451d7fb-3a86-5cf1-a537-0a12a21b5651, identifier: VU36237
2026-03-29 18:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237
2026-03-29 18:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237
2026-03-29 18:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1451d7fb-3a86-5cf1-a537-0a12a21b5651 with identifier: VU36237 to the API
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:02:12Z',
'fuel_type': 'petrol',
'id': '1451d7fb-3a86-5cf1-a537-0a12a21b5651',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU36237',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 66416,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-02',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2018}
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Saving data for VU36237: {'auction_closing_time': 1774882932.0, 'created_time': 1772728542.861412, 'last_price_update_time': 1774809951.544705}
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU36237') HTTP/1.1" 204 0
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Scrape type for HL77152: 0
2026-03-29 18:45:51 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-29 18:45:51 [auto1.de] INFO: Scrape type for UZ43781: 2
2026-03-29 18:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781
2026-03-29 18:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with scrape type 2
2026-03-29 18:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6, identifier: UZ43781
2026-03-29 18:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781
2026-03-29 18:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781
2026-03-29 18:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f37b9f-4b57-51d8-a565-82a55cc1dfe6 with identifier: UZ43781 to the API
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:57:58Z',
'fuel_type': 'petrol',
'id': '17f37b9f-4b57-51d8-a565-82a55cc1dfe6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ43781',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 104605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-11',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Saving data for UZ43781: {'auction_closing_time': 1774886278.0, 'created_time': 1773135798.311172, 'last_price_update_time': 1774809952.006865}
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ43781') HTTP/1.1" 204 0
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Scrape type for JF87432: 0
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Scrape type for UU98141: 0
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Scrape type for DY76053: 0
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Scrape type for TX40728: 2
2026-03-29 18:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-29 18:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5d53ca-6e7e-55c4-8aa7-221903807e9f with scrape type 2
2026-03-29 18:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af5d53ca-6e7e-55c4-8aa7-221903807e9f with scrape type 2
2026-03-29 18:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af5d53ca-6e7e-55c4-8aa7-221903807e9f, identifier: TX40728
2026-03-29 18:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-29 18:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-29 18:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728 to the API
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:17:21Z',
'fuel_type': 'hybrid',
'id': 'af5d53ca-6e7e-55c4-8aa7-221903807e9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40728',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 26280,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-16',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 300 de T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2022}
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-29 18:45:52 [auto1.de] INFO: Saving data for TX40728: {'auction_closing_time': 1774883841.0, 'created_time': 1773687758.105501, 'last_price_update_time': 1774809952.526084}
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX40728') HTTP/1.1" 204 0
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: US56502
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-29 18:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:52 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:52 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-29 18:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Scrape type for MN47186: 0
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Scrape type for EB09552: 2
2026-03-29 18:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-29 18:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd352567-47ca-5310-b242-b528880f452b with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd352567-47ca-5310-b242-b528880f452b with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd352567-47ca-5310-b242-b528880f452b, identifier: EB09552
2026-03-29 18:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-29 18:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552
2026-03-29 18:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd352567-47ca-5310-b242-b528880f452b with identifier: EB09552 to the API
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:13:51Z',
'fuel_type': 'petrol',
'id': 'dd352567-47ca-5310-b242-b528880f452b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB09552',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 152649,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-04-03',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Tour',
'transmission': 'manual',
'trim': 'Tour',
'year': 2006}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Saving data for EB09552: {'auction_closing_time': 1774883631.0, 'created_time': 1774522483.392692, 'last_price_update_time': 1774809953.428932}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB09552') HTTP/1.1" 204 0
2026-03-29 18:45:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Scrape type for RC78323: 2
2026-03-29 18:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-29 18:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69289757-5979-5a6e-9285-c307ec39bc45 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69289757-5979-5a6e-9285-c307ec39bc45 with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69289757-5979-5a6e-9285-c307ec39bc45, identifier: RC78323
2026-03-29 18:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-29 18:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-29 18:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323 to the API
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:31:45Z',
'fuel_type': 'diesel',
'id': '69289757-5979-5a6e-9285-c307ec39bc45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC78323',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 310154,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-31',
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Saving data for RC78323: {'auction_closing_time': 1774884705.0, 'created_time': 1773307252.562048, 'last_price_update_time': 1774809953.867206}
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC78323') HTTP/1.1" 204 0
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-29 18:45:53 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-29 18:45:53 [auto1.de] INFO: Scrape type for LF76340: 2
2026-03-29 18:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-29 18:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with scrape type 2
2026-03-29 18:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f, identifier: LF76340
2026-03-29 18:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-29 18:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340
2026-03-29 18:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ae4c973-a17d-5587-a02b-7d9ea7fbe57f with identifier: LF76340 to the API
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:05:15Z',
'fuel_type': 'petrol',
'id': '8ae4c973-a17d-5587-a02b-7d9ea7fbe57f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF76340',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 171488,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-26',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Design Edition',
'transmission': 'manual',
'trim': 'Design Edition',
'year': 2011}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Saving data for LF76340: {'auction_closing_time': 1774883115.0, 'created_time': 1774522499.579679, 'last_price_update_time': 1774809954.36904}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF76340') HTTP/1.1" 204 0
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Scrape type for JL50388: 2
2026-03-29 18:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-29 18:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a3c5e7-e8fe-5f43-9035-59aa7760c088, identifier: JL50388
2026-03-29 18:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-29 18:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-29 18:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388 to the API
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:25:00Z',
'fuel_type': 'diesel',
'id': 'a2a3c5e7-e8fe-5f43-9035-59aa7760c088',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL50388',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 229957,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-27',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Saving data for JL50388: {'auction_closing_time': 1774884300.0, 'created_time': 1773383867.613555, 'last_price_update_time': 1774809954.842474}
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL50388') HTTP/1.1" 204 0
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Scrape type for AY49158: 0
2026-03-29 18:45:54 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-29 18:45:54 [auto1.de] INFO: Scrape type for RC64301: 2
2026-03-29 18:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-29 18:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with scrape type 2
2026-03-29 18:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41, identifier: RC64301
2026-03-29 18:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-29 18:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-29 18:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301 to the API
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-30T15:04:43Z',
'fuel_type': 'diesel',
'id': '1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64301',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 161156,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-10',
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Saving data for RC64301: {'auction_closing_time': 1774883083.0, 'created_time': 1773831286.755957, 'last_price_update_time': 1774809955.311876}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64301') HTTP/1.1" 204 0
2026-03-29 18:45:55 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Scrape type for PS95073: 2
2026-03-29 18:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-29 18:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66485b15-77cf-58d8-b686-73650737398a with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66485b15-77cf-58d8-b686-73650737398a with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66485b15-77cf-58d8-b686-73650737398a, identifier: PS95073
2026-03-29 18:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-29 18:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-29 18:45:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073 to the API
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:39:38Z',
'fuel_type': 'petrol',
'id': '66485b15-77cf-58d8-b686-73650737398a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS95073',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 22143,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-07',
'seller_name': None,
'title': 'Fiat Punto Evo 1.4 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2010}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Saving data for PS95073: {'auction_closing_time': 1774885178.0, 'created_time': 1774293402.954572, 'last_price_update_time': 1774809955.776145}
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS95073') HTTP/1.1" 204 0
2026-03-29 18:45:55 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-29 18:45:55 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-29 18:45:55 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Scrape type for KV18846: 0
2026-03-29 18:45:55 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-29 18:45:55 [auto1.de] INFO: Scrape type for WW95477: 2
2026-03-29 18:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-29 18:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d97398-df78-57fd-99da-7f74d24771f7 with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d97398-df78-57fd-99da-7f74d24771f7 with scrape type 2
2026-03-29 18:45:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56d97398-df78-57fd-99da-7f74d24771f7, identifier: WW95477
2026-03-29 18:45:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-29 18:45:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-29 18:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477 to the API
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:24:58Z',
'fuel_type': 'diesel',
'id': '56d97398-df78-57fd-99da-7f74d24771f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW95477',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 97915,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-08',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2019}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Saving data for WW95477: {'auction_closing_time': 1774884298.0, 'created_time': 1773304781.249491, 'last_price_update_time': 1774809956.229822}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW95477') HTTP/1.1" 204 0
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for ZA60248: 2
2026-03-29 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-29 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05737405-74fe-59e4-9ff4-72278f6053ef with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05737405-74fe-59e4-9ff4-72278f6053ef with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05737405-74fe-59e4-9ff4-72278f6053ef, identifier: ZA60248
2026-03-29 18:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-29 18:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248
2026-03-29 18:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05737405-74fe-59e4-9ff4-72278f6053ef with identifier: ZA60248 to the API
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:36:14Z',
'fuel_type': 'petrol',
'id': '05737405-74fe-59e4-9ff4-72278f6053ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA60248',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 60565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-26',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2020}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Saving data for ZA60248: {'auction_closing_time': 1774884974.0, 'created_time': 1773858955.103501, 'last_price_update_time': 1774809956.717358}
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA60248') HTTP/1.1" 204 0
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for SX72009: 0
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for YT47398: 0
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-29 18:45:56 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-29 18:45:56 [auto1.de] INFO: Scrape type for VG18386: 2
2026-03-29 18:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-29 18:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643bca71-1a1d-51e2-a493-9be2e8e07c32 with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643bca71-1a1d-51e2-a493-9be2e8e07c32 with scrape type 2
2026-03-29 18:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643bca71-1a1d-51e2-a493-9be2e8e07c32, identifier: VG18386
2026-03-29 18:45:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-29 18:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-29 18:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386 to the API
2026-03-29 18:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 420,
'expiration_date': '2026-03-30T15:13:12Z',
'fuel_type': 'petrol',
'id': '643bca71-1a1d-51e2-a493-9be2e8e07c32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG18386',
'listing': 'auction',
'make': 'Porsche',
'model': 'Panamera',
'odometer': 135646,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-19',
'seller_name': None,
'title': 'Porsche Panamera 4S',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Saving data for VG18386: {'auction_closing_time': 1774883592.0, 'created_time': 1773773377.20829, 'last_price_update_time': 1774809957.194187}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG18386') HTTP/1.1" 204 0
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Scrape type for BB52240: 0
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Scrape type for RK52419: 0
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Scrape type for HD93241: 2
2026-03-29 18:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241
2026-03-29 18:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2, identifier: HD93241
2026-03-29 18:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241
2026-03-29 18:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241
2026-03-29 18:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79dc98a9-7049-59b4-8bca-a1762fa4c0d2 with identifier: HD93241 to the API
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 99,
'expiration_date': '2026-03-30T15:57:17Z',
'fuel_type': 'petrol',
'id': '79dc98a9-7049-59b4-8bca-a1762fa4c0d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD93241',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 59013,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-26',
'seller_name': None,
'title': 'Hyundai i30 1.4 YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2019}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Saving data for HD93241: {'auction_closing_time': 1774886237.0, 'created_time': 1774031832.294531, 'last_price_update_time': 1774809957.649537}
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD93241') HTTP/1.1" 204 0
2026-03-29 18:45:57 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-29 18:45:57 [auto1.de] INFO: Scrape type for ZS15843: 2
2026-03-29 18:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-29 18:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957f701b-78c6-5a1a-bce4-b900c77f25bc with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957f701b-78c6-5a1a-bce4-b900c77f25bc with scrape type 2
2026-03-29 18:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957f701b-78c6-5a1a-bce4-b900c77f25bc, identifier: ZS15843
2026-03-29 18:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-29 18:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-29 18:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843 to the API
2026-03-29 18:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:29:00Z',
'fuel_type': 'diesel',
'id': '957f701b-78c6-5a1a-bce4-b900c77f25bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS15843',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 129072,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-01',
'seller_name': None,
'title': 'BMW X3 xDrive 25d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Saving data for ZS15843: {'auction_closing_time': 1774884540.0, 'created_time': 1773830242.553052, 'last_price_update_time': 1774809958.182519}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS15843') HTTP/1.1" 204 0
2026-03-29 18:45:58 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6740 | hits on page: 40
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Scrape type for DP80486: 0
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Scrape type for YU21879: 2
2026-03-29 18:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-29 18:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c849ee50-57bc-5110-9c4a-d1eb0e5ade48, identifier: YU21879
2026-03-29 18:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-29 18:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-29 18:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879 to the API
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:48:29Z',
'fuel_type': 'diesel',
'id': 'c849ee50-57bc-5110-9c4a-d1eb0e5ade48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU21879',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 272863,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-07',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2011}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Saving data for YU21879: {'auction_closing_time': 1774885709.0, 'created_time': 1773230155.984021, 'last_price_update_time': 1774809958.635252}
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU21879') HTTP/1.1" 204 0
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Scrape type for HL98851: 2
2026-03-29 18:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-29 18:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6323b91-00df-5647-b5e8-8623102b58c4 with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6323b91-00df-5647-b5e8-8623102b58c4 with scrape type 2
2026-03-29 18:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6323b91-00df-5647-b5e8-8623102b58c4, identifier: HL98851
2026-03-29 18:45:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: US92808
2026-03-29 18:45:58 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-29 18:45:58 [auto1.de] INFO: Scrape type for WR57027: 0
2026-03-29 18:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-29 18:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-29 18:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851 to the API
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:45:58Z',
'fuel_type': 'petrol',
'id': 'a6323b91-00df-5647-b5e8-8623102b58c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL98851',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 102031,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-05-30',
'seller_name': None,
'title': 'Dacia Duster 1.6 Delsey 4x4',
'transmission': 'manual',
'trim': 'Delsey 4x4',
'year': 2012}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Saving data for HL98851: {'auction_closing_time': 1774885558.0, 'created_time': 1774293107.489128, 'last_price_update_time': 1774809959.099826}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL98851') HTTP/1.1" 204 0
2026-03-29 18:45:59 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Scrape type for ZG82631: 0
2026-03-29 18:45:59 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Scrape type for GT14298: 2
2026-03-29 18:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298
2026-03-29 18:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052, identifier: GT14298
2026-03-29 18:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298
2026-03-29 18:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298
2026-03-29 18:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e7ae824-5f17-5735-a5d5-cd4ee0e4a052 with identifier: GT14298 to the API
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:45:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:41:37Z',
'fuel_type': 'diesel',
'id': '9e7ae824-5f17-5735-a5d5-cd4ee0e4a052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT14298',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 115818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-11',
'seller_name': None,
'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Saving data for GT14298: {'auction_closing_time': 1774885297.0, 'created_time': 1774350205.329863, 'last_price_update_time': 1774809959.633117}
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT14298') HTTP/1.1" 204 0
2026-03-29 18:45:59 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-29 18:45:59 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-29 18:45:59 [auto1.de] INFO: Scrape type for JZ53783: 2
2026-03-29 18:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-29 18:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d253bb53-62aa-5b91-bb8e-b588abe03ee6 with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d253bb53-62aa-5b91-bb8e-b588abe03ee6 with scrape type 2
2026-03-29 18:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d253bb53-62aa-5b91-bb8e-b588abe03ee6, identifier: JZ53783
2026-03-29 18:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-29 18:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-29 18:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783 to the API
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:45:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:49:45Z',
'fuel_type': 'diesel',
'id': 'd253bb53-62aa-5b91-bb8e-b588abe03ee6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ53783',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 67594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-05',
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2021}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Saving data for JZ53783: {'auction_closing_time': 1774885785.0, 'created_time': 1773304497.641106, 'last_price_update_time': 1774809960.111888}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ53783') HTTP/1.1" 204 0
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Scrape type for KV33048: 0
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Scrape type for JH55559: 2
2026-03-29 18:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-29 18:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1f10e2-161f-58d5-8371-53961ca29a46 with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed1f10e2-161f-58d5-8371-53961ca29a46 with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed1f10e2-161f-58d5-8371-53961ca29a46, identifier: JH55559
2026-03-29 18:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-29 18:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-29 18:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559 to the API
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:44:16Z',
'fuel_type': 'diesel',
'id': 'ed1f10e2-161f-58d5-8371-53961ca29a46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH55559',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII Sportsvan',
'odometer': 154726,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-06',
'seller_name': None,
'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Allstar BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Allstar BlueMotion Tech',
'year': 2016}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Saving data for JH55559: {'auction_closing_time': 1774885456.0, 'created_time': 1773341410.568232, 'last_price_update_time': 1774809960.675171}
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH55559') HTTP/1.1" 204 0
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Scrape type for JB80015: 0
2026-03-29 18:46:00 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-29 18:46:00 [auto1.de] INFO: Scrape type for CJ75518: 2
2026-03-29 18:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-29 18:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with scrape type 2
2026-03-29 18:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff, identifier: CJ75518
2026-03-29 18:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-29 18:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-29 18:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518 to the API
2026-03-29 18:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:21:44Z',
'fuel_type': 'diesel',
'id': '1c5377ac-5e28-5ad9-b9c4-8eab17b465ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ75518',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 125691,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-08',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2016}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Saving data for CJ75518: {'auction_closing_time': 1774884104.0, 'created_time': 1774292273.678197, 'last_price_update_time': 1774809961.122843}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ75518') HTTP/1.1" 204 0
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Scrape type for RF75953: 2
2026-03-29 18:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-29 18:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f702ad-eca1-511f-8f88-30b790758684 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f702ad-eca1-511f-8f88-30b790758684 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36f702ad-eca1-511f-8f88-30b790758684, identifier: RF75953
2026-03-29 18:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-29 18:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-29 18:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953 to the API
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-30T15:21:12Z',
'fuel_type': 'diesel',
'id': '36f702ad-eca1-511f-8f88-30b790758684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF75953',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 100382,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-22',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 300 d Mild-Hybrid 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2023}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Saving data for RF75953: {'auction_closing_time': 1774884072.0, 'created_time': 1773303160.999371, 'last_price_update_time': 1774809961.614052}
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF75953') HTTP/1.1" 204 0
2026-03-29 18:46:01 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-29 18:46:01 [auto1.de] INFO: Scrape type for DV93424: 2
2026-03-29 18:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-29 18:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1760e2c3-297e-5518-8b89-54d2c988df78 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1760e2c3-297e-5518-8b89-54d2c988df78 with scrape type 2
2026-03-29 18:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1760e2c3-297e-5518-8b89-54d2c988df78, identifier: DV93424
2026-03-29 18:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-29 18:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-29 18:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424 to the API
2026-03-29 18:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:43:24Z',
'fuel_type': 'petrol',
'id': '1760e2c3-297e-5518-8b89-54d2c988df78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV93424',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 50708,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-28',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Saving data for DV93424: {'auction_closing_time': 1774885404.0, 'created_time': 1773307152.263145, 'last_price_update_time': 1774809962.224075}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV93424') HTTP/1.1" 204 0
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Scrape type for DR32988: 2
2026-03-29 18:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-29 18:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 463d34e4-9930-532b-9770-8a78e8b016c5 with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 463d34e4-9930-532b-9770-8a78e8b016c5 with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 463d34e4-9930-532b-9770-8a78e8b016c5, identifier: DR32988
2026-03-29 18:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-29 18:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988
2026-03-29 18:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 463d34e4-9930-532b-9770-8a78e8b016c5 with identifier: DR32988 to the API
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:44:30Z',
'fuel_type': 'diesel',
'id': '463d34e4-9930-532b-9770-8a78e8b016c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR32988',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 90227,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-20',
'seller_name': None,
'title': 'Ford Ranger 2.2 TDCi Doppelkabine 4x4 XLT',
'transmission': 'manual',
'trim': 'Doppelkabine 4x4 XLT',
'year': 2017}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Saving data for DR32988: {'auction_closing_time': 1774885470.0, 'created_time': 1774522694.248073, 'last_price_update_time': 1774809962.649493}
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR32988') HTTP/1.1" 204 0
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Scrape type for ZW18782: 0
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-29 18:46:02 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-29 18:46:02 [auto1.de] INFO: Scrape type for JX09791: 2
2026-03-29 18:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791
2026-03-29 18:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with scrape type 2
2026-03-29 18:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e, identifier: JX09791
2026-03-29 18:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791
2026-03-29 18:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791
2026-03-29 18:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5f7d8ec-566c-5476-8652-bc0d3a39ea3e with identifier: JX09791 to the API
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:24Z',
'fuel_type': 'petrol',
'id': 'a5f7d8ec-566c-5476-8652-bc0d3a39ea3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX09791',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 65691,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-12',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2021}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Saving data for JX09791: {'auction_closing_time': 1774883424.0, 'created_time': 1774636657.159011, 'last_price_update_time': 1774809963.09688}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX09791') HTTP/1.1" 204 0
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for RH01499: 0
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for HU68423: 0
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for CT22641: 0
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for UJ55086: 2
2026-03-29 18:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-29 18:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34, identifier: UJ55086
2026-03-29 18:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-29 18:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-29 18:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086 to the API
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:01:05Z',
'fuel_type': 'diesel',
'id': 'e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ55086',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 239166,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-13',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'BlueEfficiency Elegance',
'year': 2010}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Saving data for UJ55086: {'auction_closing_time': 1774882865.0, 'created_time': 1773380972.326889, 'last_price_update_time': 1774809963.680783}
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ55086') HTTP/1.1" 204 0
2026-03-29 18:46:03 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for JX92669: 0
2026-03-29 18:46:03 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-29 18:46:03 [auto1.de] INFO: Scrape type for VL46030: 2
2026-03-29 18:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-29 18:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1485a78a-04fa-5302-ad0d-da3eac10dc1c with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1485a78a-04fa-5302-ad0d-da3eac10dc1c with scrape type 2
2026-03-29 18:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1485a78a-04fa-5302-ad0d-da3eac10dc1c, identifier: VL46030
2026-03-29 18:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-29 18:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030
2026-03-29 18:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1485a78a-04fa-5302-ad0d-da3eac10dc1c with identifier: VL46030 to the API
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:50:08Z',
'fuel_type': 'petrol',
'id': '1485a78a-04fa-5302-ad0d-da3eac10dc1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL46030',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 48507,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-10-14',
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 500',
'transmission': 'automatic',
'trim': '',
'year': 2003}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Saving data for VL46030: {'auction_closing_time': 1774885808.0, 'created_time': 1774521588.907601, 'last_price_update_time': 1774809964.260711}
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL46030') HTTP/1.1" 204 0
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Scrape type for GX96959: 0
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Scrape type for NM81365: 0
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Scrape type for NP49973: 2
2026-03-29 18:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-29 18:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5a3740-d5e5-5d3e-896b-f870b538d12a with scrape type 2
2026-03-29 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5a3740-d5e5-5d3e-896b-f870b538d12a with scrape type 2
2026-03-29 18:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5a3740-d5e5-5d3e-896b-f870b538d12a, identifier: NP49973
2026-03-29 18:46:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Scrape type for FY09014: 0
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Scrape type for AF99280: 0
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-29 18:46:04 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-29 18:46:04 [auto1.de] INFO: Scrape type for JU04620: 2
2026-03-29 18:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-29 18:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with scrape type 2
2026-03-29 18:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with scrape type 2
2026-03-29 18:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 295ef3dd-2af7-55ec-9caf-674555bcf3d0, identifier: JU04620
2026-03-29 18:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-29 18:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-29 18:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973 to the API
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:46:23Z',
'fuel_type': 'diesel',
'id': '5d5a3740-d5e5-5d3e-896b-f870b538d12a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP49973',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 207529,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-21',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Saving data for NP49973: {'auction_closing_time': 1774885583.0, 'created_time': 1773302032.312806, 'last_price_update_time': 1774809965.030141}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP49973') HTTP/1.1" 204 0
2026-03-29 18:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-29 18:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-29 18:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620 to the API
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:40:23Z',
'fuel_type': 'petrol',
'id': '295ef3dd-2af7-55ec-9caf-674555bcf3d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU04620',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 135705,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-12',
'seller_name': None,
'title': 'Audi A1 Sportback 1.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2016}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Saving data for JU04620: {'auction_closing_time': 1774885223.0, 'created_time': 1773858928.198178, 'last_price_update_time': 1774809965.372439}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU04620') HTTP/1.1" 204 0
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Scrape type for VK72696: 2
2026-03-29 18:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-29 18:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee7b2695-032f-51d1-bde1-61a1644069a6 with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee7b2695-032f-51d1-bde1-61a1644069a6 with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee7b2695-032f-51d1-bde1-61a1644069a6, identifier: VK72696
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-29 18:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-29 18:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696
2026-03-29 18:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee7b2695-032f-51d1-bde1-61a1644069a6 with identifier: VK72696 to the API
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:02:09Z',
'fuel_type': 'petrol',
'id': 'ee7b2695-032f-51d1-bde1-61a1644069a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK72696',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 80065,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-05',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Saving data for VK72696: {'auction_closing_time': 1774882929.0, 'created_time': 1774522252.557076, 'last_price_update_time': 1774809965.776853}
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK72696') HTTP/1.1" 204 0
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-29 18:46:05 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-29 18:46:05 [auto1.de] INFO: Scrape type for PD95192: 2
2026-03-29 18:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-29 18:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with scrape type 2
2026-03-29 18:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb, identifier: PD95192
2026-03-29 18:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-29 18:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-29 18:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192 to the API
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 152,
'expiration_date': '2026-03-30T15:42:09Z',
'fuel_type': 'petrol',
'id': 'b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD95192',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 262858,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-02',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2009}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Saving data for PD95192: {'auction_closing_time': 1774885329.0, 'created_time': 1773230521.43815, 'last_price_update_time': 1774809966.382467}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD95192') HTTP/1.1" 204 0
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Scrape type for BX11616: 0
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Scrape type for FE82761: 0
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Scrape type for SW40365: 2
2026-03-29 18:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-29 18:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17940e68-d952-5e43-bfa2-8b7fd02ca307 with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17940e68-d952-5e43-bfa2-8b7fd02ca307 with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17940e68-d952-5e43-bfa2-8b7fd02ca307, identifier: SW40365
2026-03-29 18:46:06 [scrapy.extensions.logstats] INFO: Crawled 130 pages (at 10 pages/min), scraped 1103 items (at 102 items/min)
2026-03-29 18:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-29 18:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365
2026-03-29 18:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17940e68-d952-5e43-bfa2-8b7fd02ca307 with identifier: SW40365 to the API
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:17:18Z',
'fuel_type': 'diesel',
'id': '17940e68-d952-5e43-bfa2-8b7fd02ca307',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW40365',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 175452,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-18',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2021}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Saving data for SW40365: {'auction_closing_time': 1774883838.0, 'created_time': 1773380950.550579, 'last_price_update_time': 1774809966.832805}
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW40365') HTTP/1.1" 204 0
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-29 18:46:06 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-29 18:46:06 [auto1.de] INFO: Scrape type for KL73476: 2
2026-03-29 18:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-29 18:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 947a2bc2-30d5-52e0-b58e-c45210405414 with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 947a2bc2-30d5-52e0-b58e-c45210405414 with scrape type 2
2026-03-29 18:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 947a2bc2-30d5-52e0-b58e-c45210405414, identifier: KL73476
2026-03-29 18:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-29 18:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-29 18:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476 to the API
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:20:15Z',
'fuel_type': 'petrol',
'id': '947a2bc2-30d5-52e0-b58e-c45210405414',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL73476',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 178375,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-13',
'seller_name': None,
'title': 'Renault Scenic 1.6 Exception 2009',
'transmission': 'manual',
'trim': 'Exception 2009',
'year': 2009}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Saving data for KL73476: {'auction_closing_time': 1774884015.0, 'created_time': 1773383116.479284, 'last_price_update_time': 1774809967.286198}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL73476') HTTP/1.1" 204 0
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Scrape type for RP99262: 0
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Scrape type for YW50653: 2
2026-03-29 18:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-29 18:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675677bf-3e44-50d8-8159-14bd4eca7707 with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675677bf-3e44-50d8-8159-14bd4eca7707 with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675677bf-3e44-50d8-8159-14bd4eca7707, identifier: YW50653
2026-03-29 18:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-29 18:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653
2026-03-29 18:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675677bf-3e44-50d8-8159-14bd4eca7707 with identifier: YW50653 to the API
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:20:52Z',
'fuel_type': 'petrol',
'id': '675677bf-3e44-50d8-8159-14bd4eca7707',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW50653',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 233261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-31',
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i Cool',
'transmission': 'manual',
'trim': 'Cool',
'year': 2007}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Saving data for YW50653: {'auction_closing_time': 1774884052.0, 'created_time': 1774522443.96113, 'last_price_update_time': 1774809967.71719}
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW50653') HTTP/1.1" 204 0
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Scrape type for NE13487: 0
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Scrape type for BR43966: 0
2026-03-29 18:46:07 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-29 18:46:07 [auto1.de] INFO: Scrape type for KZ47858: 2
2026-03-29 18:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-29 18:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with scrape type 2
2026-03-29 18:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d, identifier: KZ47858
2026-03-29 18:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-29 18:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858
2026-03-29 18:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d with identifier: KZ47858 to the API
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:37:49Z',
'fuel_type': 'petrol',
'id': '2ea6c8af-1ab7-57dd-b6aa-25d3334edc7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ47858',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 213087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-31',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Saving data for KZ47858: {'auction_closing_time': 1774885069.0, 'created_time': 1773341316.25608, 'last_price_update_time': 1774809968.258018}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ47858') HTTP/1.1" 204 0
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Scrape type for FX67630: 0
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Scrape type for MX01041: 0
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Scrape type for LL59024: 0
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Scrape type for JG77097: 2
2026-03-29 18:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-29 18:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772d95fe-2c21-52ae-be91-3df75dad471a with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772d95fe-2c21-52ae-be91-3df75dad471a with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 772d95fe-2c21-52ae-be91-3df75dad471a, identifier: JG77097
2026-03-29 18:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-29 18:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-29 18:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097 to the API
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:46:10Z',
'fuel_type': 'diesel',
'id': '772d95fe-2c21-52ae-be91-3df75dad471a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG77097',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 240905,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-29',
'seller_name': None,
'title': 'Ford C-Max 1.5 TDCi Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2016}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Saving data for JG77097: {'auction_closing_time': 1774885570.0, 'created_time': 1773307859.902645, 'last_price_update_time': 1774809968.752531}
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG77097') HTTP/1.1" 204 0
2026-03-29 18:46:08 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-29 18:46:08 [auto1.de] INFO: Scrape type for YU15721: 2
2026-03-29 18:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-29 18:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6516615b-3391-5455-89b1-ecd93cdcf4db with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6516615b-3391-5455-89b1-ecd93cdcf4db with scrape type 2
2026-03-29 18:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6516615b-3391-5455-89b1-ecd93cdcf4db, identifier: YU15721
2026-03-29 18:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-29 18:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-29 18:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721 to the API
2026-03-29 18:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:02:08Z',
'fuel_type': 'petrol',
'id': '6516615b-3391-5455-89b1-ecd93cdcf4db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU15721',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 57801,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-07',
'seller_name': None,
'title': 'Hyundai i30 1.4 Trend blue',
'transmission': 'manual',
'trim': 'Trend blue',
'year': 2016}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Saving data for YU15721: {'auction_closing_time': 1774882928.0, 'created_time': 1773859133.93996, 'last_price_update_time': 1774809969.27855}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU15721') HTTP/1.1" 204 0
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Scrape type for BC20634: 2
2026-03-29 18:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-29 18:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with scrape type 2
2026-03-29 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with scrape type 2
2026-03-29 18:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbf5abc8-4e5a-5d2f-9122-6cf33efca500, identifier: BC20634
2026-03-29 18:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-29 18:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-29 18:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634 to the API
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:13:14Z',
'fuel_type': 'petrol',
'id': 'dbf5abc8-4e5a-5d2f-9122-6cf33efca500',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC20634',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 68368,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-14',
'seller_name': None,
'title': 'Audi Q3 Sportback 45 TFSI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2020}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Saving data for BC20634: {'auction_closing_time': 1774883594.0, 'created_time': 1773302441.659356, 'last_price_update_time': 1774809969.874415}
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC20634') HTTP/1.1" 204 0
2026-03-29 18:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:09 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-29 18:46:09 [auto1.de] INFO: Scrape type for GZ29273: 2
2026-03-29 18:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-29 18:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38b3cea-9a6f-505c-b1bf-316318f42f2d with scrape type 2
2026-03-29 18:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c38b3cea-9a6f-505c-b1bf-316318f42f2d with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c38b3cea-9a6f-505c-b1bf-316318f42f2d, identifier: GZ29273
2026-03-29 18:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-29 18:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273
2026-03-29 18:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c38b3cea-9a6f-505c-b1bf-316318f42f2d with identifier: GZ29273 to the API
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:58:06Z',
'fuel_type': 'diesel',
'id': 'c38b3cea-9a6f-505c-b1bf-316318f42f2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ29273',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 112275,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-26',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2016}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Saving data for GZ29273: {'auction_closing_time': 1774886286.0, 'created_time': 1774522350.299571, 'last_price_update_time': 1774809970.29043}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ29273') HTTP/1.1" 204 0
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Scrape type for NL95797: 2
2026-03-29 18:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-29 18:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8492b6fc-bacf-5dde-9866-4dd9dedca18d with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8492b6fc-bacf-5dde-9866-4dd9dedca18d with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8492b6fc-bacf-5dde-9866-4dd9dedca18d, identifier: NL95797
2026-03-29 18:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-29 18:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-29 18:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797 to the API
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:42:33Z',
'fuel_type': 'petrol',
'id': '8492b6fc-bacf-5dde-9866-4dd9dedca18d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL95797',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 212684,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-06-22',
'seller_name': None,
'title': 'BMW 3er 323i',
'transmission': 'automatic',
'trim': '',
'year': 1998}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Saving data for NL95797: {'auction_closing_time': 1774885353.0, 'created_time': 1773304505.260979, 'last_price_update_time': 1774809970.724174}
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL95797') HTTP/1.1" 204 0
2026-03-29 18:46:10 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Scrape type for DE56554: 0
2026-03-29 18:46:10 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-29 18:46:10 [auto1.de] INFO: Scrape type for JL37437: 2
2026-03-29 18:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-29 18:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7db25ba-476e-5bef-b9f9-71b27ebce11c with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7db25ba-476e-5bef-b9f9-71b27ebce11c with scrape type 2
2026-03-29 18:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7db25ba-476e-5bef-b9f9-71b27ebce11c, identifier: JL37437
2026-03-29 18:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-29 18:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-29 18:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437 to the API
2026-03-29 18:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:33:18Z',
'fuel_type': 'diesel',
'id': 'a7db25ba-476e-5bef-b9f9-71b27ebce11c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL37437',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T4 Transporter',
'odometer': 181174,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1995-02-14',
'seller_name': None,
'title': 'Volkswagen T4 Transporter 1.9 Turbodiesel Kasten',
'transmission': 'manual',
'trim': 'Kasten',
'year': 1995}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Saving data for JL37437: {'auction_closing_time': 1774884798.0, 'created_time': 1773382135.095408, 'last_price_update_time': 1774809971.195138}
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL37437') HTTP/1.1" 204 0
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Scrape type for LG94407: 2
2026-03-29 18:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407
2026-03-29 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7b9c088-c5d1-51e9-b3de-c86b44b4f347, identifier: LG94407
2026-03-29 18:46:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Scrape type for TN04984: 0
2026-03-29 18:46:11 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-29 18:46:11 [auto1.de] INFO: Scrape type for FH05972: 2
2026-03-29 18:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972
2026-03-29 18:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47863fa4-4f46-59af-be65-653ddf1ce0e1 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47863fa4-4f46-59af-be65-653ddf1ce0e1 with scrape type 2
2026-03-29 18:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47863fa4-4f46-59af-be65-653ddf1ce0e1, identifier: FH05972
2026-03-29 18:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407
2026-03-29 18:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407
2026-03-29 18:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407 to the API
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:28:12Z',
'fuel_type': 'petrol',
'id': 'f7b9c088-c5d1-51e9-b3de-c86b44b4f347',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG94407',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 106127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-08',
'seller_name': None,
'title': 'Renault Grand Scenic 1.3 TCe Energy BOSE-Edition',
'transmission': 'manual',
'trim': 'BOSE-Edition',
'year': 2018}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Saving data for LG94407: {'auction_closing_time': 1774884492.0, 'created_time': 1774510547.542065, 'last_price_update_time': 1774809972.239604}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG94407') HTTP/1.1" 204 0
2026-03-29 18:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972
2026-03-29 18:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972
2026-03-29 18:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47863fa4-4f46-59af-be65-653ddf1ce0e1 with identifier: FH05972 to the API
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:49:44Z',
'fuel_type': 'petrol',
'id': '47863fa4-4f46-59af-be65-653ddf1ce0e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH05972',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 118245,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-28',
'seller_name': None,
'title': 'MINI Clubman Cooper S ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2018}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Saving data for FH05972: {'auction_closing_time': 1774885784.0, 'created_time': 1774636908.340742, 'last_price_update_time': 1774809972.648215}
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH05972') HTTP/1.1" 204 0
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Scrape type for JN34556: 0
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-29 18:46:12 [auto1.de] INFO: Scrape type for WR98876: 2
2026-03-29 18:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876
2026-03-29 18:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with scrape type 2
2026-03-29 18:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with scrape type 2
2026-03-29 18:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8, identifier: WR98876
2026-03-29 18:46:12 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-29 18:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876
2026-03-29 18:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876
2026-03-29 18:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 386ea913-8fd4-540e-a0ce-6b4f54eb4cc8 with identifier: WR98876 to the API
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:10:40Z',
'fuel_type': 'diesel',
'id': '386ea913-8fd4-540e-a0ce-6b4f54eb4cc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR98876',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 170672,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-31',
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
'transmission': 'automatic',
'trim': 'quattro S line Sportpaket plus',
'year': 2015}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Saving data for WR98876: {'auction_closing_time': 1774883440.0, 'created_time': 1774350530.293288, 'last_price_update_time': 1774809973.111215}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR98876') HTTP/1.1" 204 0
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for UB28690: 2
2026-03-29 18:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690
2026-03-29 18:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4fe42eb-4935-5113-a40b-b9debac213ec with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4fe42eb-4935-5113-a40b-b9debac213ec with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4fe42eb-4935-5113-a40b-b9debac213ec, identifier: UB28690
2026-03-29 18:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690
2026-03-29 18:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690
2026-03-29 18:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4fe42eb-4935-5113-a40b-b9debac213ec with identifier: UB28690 to the API
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:25:52Z',
'fuel_type': 'petrol',
'id': 'b4fe42eb-4935-5113-a40b-b9debac213ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB28690',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 101427,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-13',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo ON',
'transmission': 'manual',
'trim': 'ON',
'year': 2017}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Saving data for UB28690: {'auction_closing_time': 1774884352.0, 'created_time': 1774636617.852686, 'last_price_update_time': 1774809973.523589}
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB28690') HTTP/1.1" 204 0
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for WF57615: 0
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for LB03108: 0
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for GL61912: 0
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for PC78051: 0
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-29 18:46:13 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-29 18:46:13 [auto1.de] INFO: Scrape type for KG12536: 2
2026-03-29 18:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-29 18:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c05c1b57-e540-5855-8256-e1d569276788 with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c05c1b57-e540-5855-8256-e1d569276788 with scrape type 2
2026-03-29 18:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c05c1b57-e540-5855-8256-e1d569276788, identifier: KG12536
2026-03-29 18:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-29 18:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-29 18:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536 to the API
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:47:08Z',
'fuel_type': 'diesel',
'id': 'c05c1b57-e540-5855-8256-e1d569276788',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG12536',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 233115,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-27',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline',
'transmission': 'automatic',
'trim': 'Maxi Comfortline',
'year': 2013}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Saving data for KG12536: {'auction_closing_time': 1774885628.0, 'created_time': 1773831739.05196, 'last_price_update_time': 1774809974.043472}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG12536') HTTP/1.1" 204 0
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Scrape type for BY51393: 0
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Scrape type for KV18345: 2
2026-03-29 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-29 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7061eccb-bcde-5f92-8794-faa4bd88fcc5, identifier: KV18345
2026-03-29 18:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-29 18:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345
2026-03-29 18:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7061eccb-bcde-5f92-8794-faa4bd88fcc5 with identifier: KV18345 to the API
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:38:55Z',
'fuel_type': 'petrol',
'id': '7061eccb-bcde-5f92-8794-faa4bd88fcc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV18345',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 109253,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-07',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Saving data for KV18345: {'auction_closing_time': 1774885135.0, 'created_time': 1773400237.049561, 'last_price_update_time': 1774809974.578819}
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV18345') HTTP/1.1" 204 0
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Scrape type for EU36809: 0
2026-03-29 18:46:14 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-29 18:46:14 [auto1.de] INFO: Scrape type for LF81800: 2
2026-03-29 18:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-29 18:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f537fabd-01eb-5925-9c49-4eeb5f2847d0 with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f537fabd-01eb-5925-9c49-4eeb5f2847d0 with scrape type 2
2026-03-29 18:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f537fabd-01eb-5925-9c49-4eeb5f2847d0, identifier: LF81800
2026-03-29 18:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-29 18:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-29 18:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800 to the API
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:53:17Z',
'fuel_type': 'diesel',
'id': 'f537fabd-01eb-5925-9c49-4eeb5f2847d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF81800',
'listing': 'auction',
'make': 'Opel',
'model': 'Vivaro',
'odometer': 51374,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-05-02',
'seller_name': None,
'title': 'Opel Vivaro 1.5 CDTI M Edition L2',
'transmission': 'manual',
'trim': 'M Edition L2',
'year': 2024}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Saving data for LF81800: {'auction_closing_time': 1774885997.0, 'created_time': 1773946473.89168, 'last_price_update_time': 1774809975.050572}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF81800') HTTP/1.1" 204 0
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Scrape type for LK89545: 2
2026-03-29 18:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-29 18:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb70ee21-5451-5415-98ab-70362eaed48a with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb70ee21-5451-5415-98ab-70362eaed48a with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb70ee21-5451-5415-98ab-70362eaed48a, identifier: LK89545
2026-03-29 18:46:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-29 18:46:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-29 18:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545 to the API
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:54:25Z',
'fuel_type': 'diesel',
'id': 'bb70ee21-5451-5415-98ab-70362eaed48a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK89545',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 149381,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-22',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI SportLine',
'transmission': 'automatic',
'trim': 'SportLine',
'year': 2019}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Saving data for LK89545: {'auction_closing_time': 1774886065.0, 'created_time': 1774251386.456911, 'last_price_update_time': 1774809975.495949}
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK89545') HTTP/1.1" 204 0
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Scrape type for MZ37789: 0
2026-03-29 18:46:15 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-29 18:46:15 [auto1.de] INFO: Scrape type for WT06361: 2
2026-03-29 18:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-29 18:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc68f7b-d13b-59da-806a-9ec51780cac0 with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc68f7b-d13b-59da-806a-9ec51780cac0 with scrape type 2
2026-03-29 18:46:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc68f7b-d13b-59da-806a-9ec51780cac0, identifier: WT06361
2026-03-29 18:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-29 18:46:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-29 18:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361 to the API
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:38:53Z',
'fuel_type': 'petrol',
'id': 'edc68f7b-d13b-59da-806a-9ec51780cac0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06361',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 82581,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-25',
'seller_name': None,
'title': 'Honda Jazz 1.4 Si',
'transmission': 'manual',
'trim': 'Si',
'year': 2013}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Saving data for WT06361: {'auction_closing_time': 1774885133.0, 'created_time': 1774294840.7253, 'last_price_update_time': 1774809976.098404}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT06361') HTTP/1.1" 204 0
2026-03-29 18:46:16 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Scrape type for GA31653: 2
2026-03-29 18:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-29 18:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48, identifier: GA31653
2026-03-29 18:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-29 18:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-29 18:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653 to the API
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:19:04Z',
'fuel_type': 'petrol',
'id': '08b001bf-ba1b-54de-ac6b-409fcb5c8f48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA31653',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 86445,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-14',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2003}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Saving data for GA31653: {'auction_closing_time': 1774883944.0, 'created_time': 1774293769.249585, 'last_price_update_time': 1774809976.546067}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA31653') HTTP/1.1" 204 0
2026-03-29 18:46:16 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Scrape type for TY20606: 2
2026-03-29 18:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-29 18:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c063c708-91ba-5810-9f8f-8005f1f4822d with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c063c708-91ba-5810-9f8f-8005f1f4822d with scrape type 2
2026-03-29 18:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c063c708-91ba-5810-9f8f-8005f1f4822d, identifier: TY20606
2026-03-29 18:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-29 18:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-29 18:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606 to the API
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:56:00Z',
'fuel_type': 'petrol',
'id': 'c063c708-91ba-5810-9f8f-8005f1f4822d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY20606',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 64971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-14',
'seller_name': None,
'title': 'Dacia Duster 1.3 TCe Journey',
'transmission': 'automatic',
'trim': 'Journey',
'year': 2023}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-29 18:46:16 [auto1.de] INFO: Saving data for TY20606: {'auction_closing_time': 1774886160.0, 'created_time': 1773383238.051134, 'last_price_update_time': 1774809976.976294}
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY20606') HTTP/1.1" 204 0
2026-03-29 18:46:16 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:16 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Scrape type for NE15652: 2
2026-03-29 18:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-29 18:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bfbccf7-7c56-5133-902d-fff59677f178 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bfbccf7-7c56-5133-902d-fff59677f178 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bfbccf7-7c56-5133-902d-fff59677f178, identifier: NE15652
2026-03-29 18:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-29 18:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-29 18:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652 to the API
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:15:35Z',
'fuel_type': 'petrol',
'id': '1bfbccf7-7c56-5133-902d-fff59677f178',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE15652',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i10',
'odometer': 166645,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-04',
'seller_name': None,
'title': 'Hyundai i10 1.0 Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2019}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Saving data for NE15652: {'auction_closing_time': 1774883735.0, 'created_time': 1774607763.861742, 'last_price_update_time': 1774809977.451215}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE15652') HTTP/1.1" 204 0
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Scrape type for VB50178: 0
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Scrape type for NZ01572: 2
2026-03-29 18:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-29 18:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7173c4-6055-5527-abce-5252f34ae246 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc7173c4-6055-5527-abce-5252f34ae246 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc7173c4-6055-5527-abce-5252f34ae246, identifier: NZ01572
2026-03-29 18:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-29 18:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-29 18:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572 to the API
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:27:16Z',
'fuel_type': 'petrol',
'id': 'cc7173c4-6055-5527-abce-5252f34ae246',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ01572',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 57689,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-16',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Saving data for NZ01572: {'auction_closing_time': 1774884436.0, 'created_time': 1773775084.116803, 'last_price_update_time': 1774809977.901123}
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ01572') HTTP/1.1" 204 0
2026-03-29 18:46:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:17 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-29 18:46:17 [auto1.de] INFO: Scrape type for NE19972: 2
2026-03-29 18:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972
2026-03-29 18:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df834e0e-34ab-55f6-a58c-8774994ea020 with scrape type 2
2026-03-29 18:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df834e0e-34ab-55f6-a58c-8774994ea020 with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df834e0e-34ab-55f6-a58c-8774994ea020, identifier: NE19972
2026-03-29 18:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972
2026-03-29 18:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972
2026-03-29 18:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df834e0e-34ab-55f6-a58c-8774994ea020 with identifier: NE19972 to the API
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:04:57Z',
'fuel_type': 'diesel',
'id': 'df834e0e-34ab-55f6-a58c-8774994ea020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE19972',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 238525,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-11',
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Saving data for NE19972: {'auction_closing_time': 1774883097.0, 'created_time': 1774033080.585198, 'last_price_update_time': 1774809978.300785}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE19972') HTTP/1.1" 204 0
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Scrape type for CP50790: 0
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Scrape type for WU91677: 2
2026-03-29 18:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-29 18:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458562e3-27f6-52aa-9eaf-998992f036b9 with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458562e3-27f6-52aa-9eaf-998992f036b9 with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 458562e3-27f6-52aa-9eaf-998992f036b9, identifier: WU91677
2026-03-29 18:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-29 18:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-29 18:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677 to the API
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:33Z',
'fuel_type': 'diesel',
'id': '458562e3-27f6-52aa-9eaf-998992f036b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU91677',
'listing': 'auction',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 191761,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-29',
'seller_name': None,
'title': 'Nissan X-Trail 2.0 dCi LE 4x4',
'transmission': 'manual',
'trim': 'LE 4x4',
'year': 2014}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Saving data for WU91677: {'auction_closing_time': 1774883493.0, 'created_time': 1773307687.957752, 'last_price_update_time': 1774809978.768229}
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU91677') HTTP/1.1" 204 0
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Scrape type for YF79248: 0
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-29 18:46:18 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-29 18:46:18 [auto1.de] INFO: Scrape type for NK53054: 2
2026-03-29 18:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-29 18:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96419e94-377d-57d7-9b8a-a7e029e76ed9 with scrape type 2
2026-03-29 18:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96419e94-377d-57d7-9b8a-a7e029e76ed9 with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96419e94-377d-57d7-9b8a-a7e029e76ed9, identifier: NK53054
2026-03-29 18:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-29 18:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-29 18:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054 to the API
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:14:56Z',
'fuel_type': 'petrol',
'id': '96419e94-377d-57d7-9b8a-a7e029e76ed9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK53054',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 83922,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-16',
'seller_name': None,
'title': 'Volkswagen Beetle 1.2 TSI Club BlueMotion Tech',
'transmission': 'manual',
'trim': 'Club BlueMotion Tech',
'year': 2016}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Saving data for NK53054: {'auction_closing_time': 1774883696.0, 'created_time': 1774608083.567906, 'last_price_update_time': 1774809979.341704}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK53054') HTTP/1.1" 204 0
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Scrape type for SG14297: 2
2026-03-29 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297
2026-03-29 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b136346-3d12-5785-8a21-af8db765002b with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b136346-3d12-5785-8a21-af8db765002b with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b136346-3d12-5785-8a21-af8db765002b, identifier: SG14297
2026-03-29 18:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297
2026-03-29 18:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297
2026-03-29 18:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b136346-3d12-5785-8a21-af8db765002b with identifier: SG14297 to the API
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:58Z',
'fuel_type': 'petrol',
'id': '5b136346-3d12-5785-8a21-af8db765002b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG14297',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 136637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-03',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBoost ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2019}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Saving data for SG14297: {'auction_closing_time': 1774884778.0, 'created_time': 1774636585.851593, 'last_price_update_time': 1774809979.757957}
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG14297') HTTP/1.1" 204 0
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Scrape type for KG05559: 0
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-29 18:46:19 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-29 18:46:19 [auto1.de] INFO: Scrape type for XX81034: 2
2026-03-29 18:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-29 18:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2587d3d4-9854-57c2-a48f-fd751d94b628 with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2587d3d4-9854-57c2-a48f-fd751d94b628 with scrape type 2
2026-03-29 18:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2587d3d4-9854-57c2-a48f-fd751d94b628, identifier: XX81034
2026-03-29 18:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-29 18:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-29 18:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034 to the API
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 215,
'expiration_date': '2026-03-30T15:13:33Z',
'fuel_type': 'diesel',
'id': '2587d3d4-9854-57c2-a48f-fd751d94b628',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX81034',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 221216,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-01',
'seller_name': None,
'title': 'Volvo XC60 2.4 D5 Ocean Race AWD',
'transmission': 'automatic',
'trim': 'Ocean Race AWD',
'year': 2012}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Saving data for XX81034: {'auction_closing_time': 1774883613.0, 'created_time': 1773774223.806507, 'last_price_update_time': 1774809980.237413}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX81034') HTTP/1.1" 204 0
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Scrape type for GV33356: 2
2026-03-29 18:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-29 18:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 141b9907-123c-5e4e-aa39-3105849030d0 with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 141b9907-123c-5e4e-aa39-3105849030d0 with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 141b9907-123c-5e4e-aa39-3105849030d0, identifier: GV33356
2026-03-29 18:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-29 18:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-29 18:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356 to the API
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:07:55Z',
'fuel_type': 'petrol',
'id': '141b9907-123c-5e4e-aa39-3105849030d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV33356',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 189332,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-30',
'seller_name': None,
'title': 'Opel Zafira 1.6 Design Edition',
'transmission': 'manual',
'trim': 'Design Edition',
'year': 2011}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Saving data for GV33356: {'auction_closing_time': 1774883275.0, 'created_time': 1773304581.608919, 'last_price_update_time': 1774809980.792826}
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV33356') HTTP/1.1" 204 0
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Scrape type for MA12811: 0
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-29 18:46:20 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-29 18:46:20 [auto1.de] INFO: Scrape type for XY91338: 2
2026-03-29 18:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-29 18:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e0c513-ccc4-5e57-9334-661cf7013330 with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59e0c513-ccc4-5e57-9334-661cf7013330 with scrape type 2
2026-03-29 18:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59e0c513-ccc4-5e57-9334-661cf7013330, identifier: XY91338
2026-03-29 18:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-29 18:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-29 18:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338 to the API
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:49:44Z',
'fuel_type': 'diesel',
'id': '59e0c513-ccc4-5e57-9334-661cf7013330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY91338',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 140507,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-05',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Saving data for XY91338: {'auction_closing_time': 1774885784.0, 'created_time': 1773402132.286524, 'last_price_update_time': 1774809981.274939}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY91338') HTTP/1.1" 204 0
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Scrape type for BH43917: 0
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Scrape type for SY47772: 2
2026-03-29 18:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-29 18:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53242f5d-d059-53ce-9533-c8e9f9ba632c with scrape type 2
2026-03-29 18:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53242f5d-d059-53ce-9533-c8e9f9ba632c with scrape type 2
2026-03-29 18:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53242f5d-d059-53ce-9533-c8e9f9ba632c, identifier: SY47772
2026-03-29 18:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-29 18:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-29 18:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772 to the API
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:11:21Z',
'fuel_type': 'petrol',
'id': '53242f5d-d059-53ce-9533-c8e9f9ba632c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY47772',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 88581,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-04',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
'transmission': 'automatic',
'trim': 'GTI Clubsport',
'year': 2021}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Saving data for SY47772: {'auction_closing_time': 1774883481.0, 'created_time': 1773861577.476407, 'last_price_update_time': 1774809981.732319}
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY47772') HTTP/1.1" 204 0
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-29 18:46:21 [auto1.de] INFO: Scrape type for KG98772: 0
2026-03-29 18:46:21 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-29 18:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:22 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-29 18:46:22 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-29 18:46:22 [auto1.de] INFO: Scrape type for TE97467: 2
2026-03-29 18:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-29 18:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with scrape type 2
2026-03-29 18:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with scrape type 2
2026-03-29 18:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08753a89-d7c3-5b67-9b86-47ea2c2b1030, identifier: TE97467
2026-03-29 18:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-29 18:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-29 18:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467 to the API
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:01:18Z',
'fuel_type': 'hybrid',
'id': '08753a89-d7c3-5b67-9b86-47ea2c2b1030',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE97467',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 22601,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-06',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.4 PHEV 4WD',
'transmission': 'automatic',
'trim': '4WD',
'year': 2020}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Saving data for TE97467: {'auction_closing_time': 1774882878.0, 'created_time': 1773860939.920139, 'last_price_update_time': 1774809983.276859}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE97467') HTTP/1.1" 204 0
2026-03-29 18:46:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for VK49169: 0
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for EN92666: 0
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK27432%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for GK27432: 2
2026-03-29 18:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432
2026-03-29 18:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520c739a-9c5a-5441-b65b-f3a594cf4c5a with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 520c739a-9c5a-5441-b65b-f3a594cf4c5a with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 520c739a-9c5a-5441-b65b-f3a594cf4c5a, identifier: GK27432
2026-03-29 18:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432
2026-03-29 18:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432
2026-03-29 18:46:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 520c739a-9c5a-5441-b65b-f3a594cf4c5a with identifier: GK27432 to the API
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:26:23Z',
'fuel_type': 'petrol',
'id': '520c739a-9c5a-5441-b65b-f3a594cf4c5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK27432',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 278261,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-03-13',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 240 Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2002}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK27432%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Saving data for GK27432: {'auction_closing_time': 1774884383.0, 'created_time': 1774723320.871662, 'last_price_update_time': 1774809983.742474}
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK27432') HTTP/1.1" 204 0
2026-03-29 18:46:23 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK36740%27 HTTP/1.1" 200 None
2026-03-29 18:46:23 [auto1.de] INFO: Scrape type for VK36740: 2
2026-03-29 18:46:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740
2026-03-29 18:46:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3073702-3572-540f-8ce3-5b97d2a731b9 with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3073702-3572-540f-8ce3-5b97d2a731b9 with scrape type 2
2026-03-29 18:46:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3073702-3572-540f-8ce3-5b97d2a731b9, identifier: VK36740
2026-03-29 18:46:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740
2026-03-29 18:46:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740
2026-03-29 18:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3073702-3572-540f-8ce3-5b97d2a731b9 with identifier: VK36740 to the API
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:32:43Z',
'fuel_type': 'petrol',
'id': 'c3073702-3572-540f-8ce3-5b97d2a731b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK36740',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 269412,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-07-03',
'seller_name': None,
'title': 'BMW X5 3.0i',
'transmission': 'automatic',
'trim': '',
'year': 2001}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK36740%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Saving data for VK36740: {'auction_closing_time': 1774884763.0, 'created_time': 1774723318.754257, 'last_price_update_time': 1774809984.249384}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK36740') HTTP/1.1" 204 0
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Scrape type for WL85831: 0
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Scrape type for LJ39551: 2
2026-03-29 18:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-29 18:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bafad74d-0159-5389-a6c8-70089e10eb93 with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bafad74d-0159-5389-a6c8-70089e10eb93 with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bafad74d-0159-5389-a6c8-70089e10eb93, identifier: LJ39551
2026-03-29 18:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-29 18:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551
2026-03-29 18:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bafad74d-0159-5389-a6c8-70089e10eb93 with identifier: LJ39551 to the API
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:33:48Z',
'fuel_type': 'petrol',
'id': 'bafad74d-0159-5389-a6c8-70089e10eb93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ39551',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 64916,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-03',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
'transmission': 'automatic',
'trim': 'GTI Clubsport',
'year': 2021}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Saving data for LJ39551: {'auction_closing_time': 1774884828.0, 'created_time': 1774522247.521105, 'last_price_update_time': 1774809984.713676}
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ39551') HTTP/1.1" 204 0
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Scrape type for TX92076: 0
2026-03-29 18:46:24 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-29 18:46:24 [auto1.de] INFO: Scrape type for FV21429: 2
2026-03-29 18:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-29 18:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbe1fad-6da1-58c2-a81d-eea7784a439f with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffbe1fad-6da1-58c2-a81d-eea7784a439f with scrape type 2
2026-03-29 18:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffbe1fad-6da1-58c2-a81d-eea7784a439f, identifier: FV21429
2026-03-29 18:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-29 18:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-29 18:46:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429 to the API
2026-03-29 18:46:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:36:33Z',
'fuel_type': 'hybrid',
'id': 'ffbe1fad-6da1-58c2-a81d-eea7784a439f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV21429',
'listing': 'auction',
'make': 'Seat',
'model': 'Tarraco',
'odometer': 99531,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-08',
'seller_name': None,
'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
'transmission': 'automatic',
'trim': 'FR',
'year': 2021}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Saving data for FV21429: {'auction_closing_time': 1774884993.0, 'created_time': 1772543706.558235, 'last_price_update_time': 1774809985.176205}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV21429') HTTP/1.1" 204 0
2026-03-29 18:46:25 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-29 18:46:25 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Scrape type for CY33039: 2
2026-03-29 18:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-29 18:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a3b39f-620e-5e34-af76-592760220052 with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57a3b39f-620e-5e34-af76-592760220052 with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57a3b39f-620e-5e34-af76-592760220052, identifier: CY33039
2026-03-29 18:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-29 18:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-29 18:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039 to the API
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:53:51Z',
'fuel_type': 'petrol',
'id': '57a3b39f-620e-5e34-af76-592760220052',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY33039',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 219827,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-31',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Fresh',
'transmission': 'manual',
'trim': 'Fresh',
'year': 2013}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Saving data for CY33039: {'auction_closing_time': 1774886031.0, 'created_time': 1774262936.886555, 'last_price_update_time': 1774809985.672648}
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY33039') HTTP/1.1" 204 0
2026-03-29 18:46:25 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-29 18:46:25 [auto1.de] INFO: Scrape type for CR82363: 2
2026-03-29 18:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-29 18:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8115376a-7023-509e-b254-34d98d67b8b8 with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8115376a-7023-509e-b254-34d98d67b8b8 with scrape type 2
2026-03-29 18:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8115376a-7023-509e-b254-34d98d67b8b8, identifier: CR82363
2026-03-29 18:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-29 18:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-29 18:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363 to the API
2026-03-29 18:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:07:19Z',
'fuel_type': 'petrol',
'id': '8115376a-7023-509e-b254-34d98d67b8b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR82363',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 142574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-19',
'seller_name': None,
'title': 'BMW 1er 120i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Saving data for CR82363: {'auction_closing_time': 1774883239.0, 'created_time': 1772728201.318158, 'last_price_update_time': 1774809986.120674}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR82363') HTTP/1.1" 204 0
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Scrape type for SZ45535: 0
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Scrape type for KL68094: 2
2026-03-29 18:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-29 18:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2, identifier: KL68094
2026-03-29 18:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-29 18:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094
2026-03-29 18:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2 with identifier: KL68094 to the API
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:54Z',
'fuel_type': 'petrol',
'id': 'fbbd1bd5-d617-5eb5-8ab5-cb83dd1420f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL68094',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 255845,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-03-06',
'seller_name': None,
'title': 'Audi A4 1.8 Turbo',
'transmission': 'manual',
'trim': '',
'year': 2000}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Saving data for KL68094: {'auction_closing_time': 1774884714.0, 'created_time': 1774035153.734983, 'last_price_update_time': 1774809986.641388}
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL68094') HTTP/1.1" 204 0
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Scrape type for KA00227: 0
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Scrape type for BM31151: 0
2026-03-29 18:46:26 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-29 18:46:26 [auto1.de] INFO: Scrape type for PM88586: 2
2026-03-29 18:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586
2026-03-29 18:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9728d942-351f-5e65-9063-75a6b4a3262b with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9728d942-351f-5e65-9063-75a6b4a3262b with scrape type 2
2026-03-29 18:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9728d942-351f-5e65-9063-75a6b4a3262b, identifier: PM88586
2026-03-29 18:46:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586
2026-03-29 18:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586
2026-03-29 18:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9728d942-351f-5e65-9063-75a6b4a3262b with identifier: PM88586 to the API
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:57:00Z',
'fuel_type': 'diesel',
'id': '9728d942-351f-5e65-9063-75a6b4a3262b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM88586',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 137101,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-23',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi S',
'transmission': 'manual',
'trim': 'S',
'year': 2011}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Saving data for PM88586: {'auction_closing_time': 1774886220.0, 'created_time': 1774636647.317263, 'last_price_update_time': 1774809987.082306}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM88586') HTTP/1.1" 204 0
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Scrape type for GG98787: 2
2026-03-29 18:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-29 18:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201b1528-c597-568e-a491-95d8e6b5118b with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201b1528-c597-568e-a491-95d8e6b5118b with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 201b1528-c597-568e-a491-95d8e6b5118b, identifier: GG98787
2026-03-29 18:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-29 18:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-29 18:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787 to the API
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:56:26Z',
'fuel_type': 'diesel',
'id': '201b1528-c597-568e-a491-95d8e6b5118b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG98787',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 174877,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-24',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Team BlueMotion',
'transmission': 'manual',
'trim': 'Team BlueMotion',
'year': 2011}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Saving data for GG98787: {'auction_closing_time': 1774886186.0, 'created_time': 1774263223.255215, 'last_price_update_time': 1774809987.662811}
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG98787') HTTP/1.1" 204 0
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-29 18:46:27 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Scrape type for BE24372: 0
2026-03-29 18:46:27 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-29 18:46:27 [auto1.de] INFO: Scrape type for HX18202: 2
2026-03-29 18:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-29 18:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with scrape type 2
2026-03-29 18:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327, identifier: HX18202
2026-03-29 18:46:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-29 18:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-29 18:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202 to the API
2026-03-29 18:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:37Z',
'fuel_type': 'petrol',
'id': '89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX18202',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 109637,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-03',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2017}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Saving data for HX18202: {'auction_closing_time': 1774882957.0, 'created_time': 1774290982.724862, 'last_price_update_time': 1774809988.139281}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX18202') HTTP/1.1" 204 0
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Scrape type for ZN65231: 0
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Scrape type for FK36654: 2
2026-03-29 18:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-29 18:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e, identifier: FK36654
2026-03-29 18:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-29 18:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-29 18:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654 to the API
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:56:56Z',
'fuel_type': 'diesel',
'id': '0e98327a-4893-5aa9-a9a1-70c274d8dc4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK36654',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 160711,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-03',
'seller_name': None,
'title': 'Volkswagen Golf Plus 2.0 TDI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2013}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Saving data for FK36654: {'auction_closing_time': 1774886216.0, 'created_time': 1774293273.349653, 'last_price_update_time': 1774809988.673954}
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK36654') HTTP/1.1" 204 0
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Scrape type for FB58638: 0
2026-03-29 18:46:28 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-29 18:46:28 [auto1.de] INFO: Scrape type for LV47567: 2
2026-03-29 18:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-29 18:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with scrape type 2
2026-03-29 18:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9, identifier: LV47567
2026-03-29 18:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-29 18:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-29 18:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567 to the API
2026-03-29 18:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:32:07Z',
'fuel_type': 'petrol',
'id': 'c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV47567',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SL-Klasse',
'odometer': 111522,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-03',
'seller_name': None,
'title': 'Mercedes-Benz SL-Klasse SL 350',
'transmission': 'automatic',
'trim': '',
'year': 2005}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Saving data for LV47567: {'auction_closing_time': 1774884727.0, 'created_time': 1773136055.532977, 'last_price_update_time': 1774809989.134477}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV47567') HTTP/1.1" 204 0
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Scrape type for TT67137: 0
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Scrape type for CD81555: 2
2026-03-29 18:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-29 18:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953a0633-1769-5717-8fec-b8892482a997 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953a0633-1769-5717-8fec-b8892482a997 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 953a0633-1769-5717-8fec-b8892482a997, identifier: CD81555
2026-03-29 18:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-29 18:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-29 18:46:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555 to the API
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 238,
'expiration_date': '2026-03-30T15:59:58Z',
'fuel_type': 'diesel',
'id': '953a0633-1769-5717-8fec-b8892482a997',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD81555',
'listing': 'auction',
'make': 'Ford',
'model': 'Edge',
'odometer': 94289,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-02',
'seller_name': None,
'title': 'Ford Edge 2.0 TDCi EcoBlue ST-Line 4x4',
'transmission': 'automatic',
'trim': 'ST-Line 4x4',
'year': 2019}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Saving data for CD81555: {'auction_closing_time': 1774886398.0, 'created_time': 1774293613.284069, 'last_price_update_time': 1774809989.791421}
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD81555') HTTP/1.1" 204 0
2026-03-29 18:46:29 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-29 18:46:29 [auto1.de] INFO: Scrape type for FS32666: 2
2026-03-29 18:46:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-29 18:46:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2dd30a2-4a92-594f-abd0-554146a32812 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2dd30a2-4a92-594f-abd0-554146a32812 with scrape type 2
2026-03-29 18:46:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2dd30a2-4a92-594f-abd0-554146a32812, identifier: FS32666
2026-03-29 18:46:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-29 18:46:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-29 18:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666 to the API
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:36:50Z',
'fuel_type': 'petrol',
'id': 'a2dd30a2-4a92-594f-abd0-554146a32812',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS32666',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 88669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-16',
'seller_name': None,
'title': 'Dacia Duster 1.2 TCe Urban Explorer 4x2',
'transmission': 'manual',
'trim': 'Urban Explorer 4x2',
'year': 2015}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Saving data for FS32666: {'auction_closing_time': 1774885010.0, 'created_time': 1774607861.316366, 'last_price_update_time': 1774809990.277681}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS32666') HTTP/1.1" 204 0
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Scrape type for FT28462: 0
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Scrape type for YW34309: 0
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Scrape type for UK53846: 2
2026-03-29 18:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-29 18:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6, identifier: UK53846
2026-03-29 18:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-29 18:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-29 18:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846 to the API
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:00:50Z',
'fuel_type': 'petrol',
'id': '7f7401ab-5e10-5402-a6c8-c37fa7f68cb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK53846',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 54342,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-22',
'seller_name': None,
'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2020}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Saving data for UK53846: {'auction_closing_time': 1774882850.0, 'created_time': 1774291040.363657, 'last_price_update_time': 1774809990.758905}
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK53846') HTTP/1.1" 204 0
2026-03-29 18:46:30 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT49919%27 HTTP/1.1" 200 None
2026-03-29 18:46:30 [auto1.de] INFO: Scrape type for UT49919: 2
2026-03-29 18:46:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919
2026-03-29 18:46:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be943f07-6bfb-597b-b7e4-8b3d1dea8147 with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be943f07-6bfb-597b-b7e4-8b3d1dea8147 with scrape type 2
2026-03-29 18:46:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be943f07-6bfb-597b-b7e4-8b3d1dea8147, identifier: UT49919
2026-03-29 18:46:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919
2026-03-29 18:46:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919
2026-03-29 18:46:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be943f07-6bfb-597b-b7e4-8b3d1dea8147 with identifier: UT49919 to the API
2026-03-29 18:46:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:31:19Z',
'fuel_type': 'diesel',
'id': 'be943f07-6bfb-597b-b7e4-8b3d1dea8147',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT49919',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 197041,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-27',
'seller_name': None,
'title': 'BMW X4 xDrive 35d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT49919%27 HTTP/1.1" 200 None
2026-03-29 18:46:31 [auto1.de] INFO: Saving data for UT49919: {'auction_closing_time': 1774884679.0, 'created_time': 1773400138.788004, 'last_price_update_time': 1774809991.431028}
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT49919') HTTP/1.1" 204 0
2026-03-29 18:46:31 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-29 18:46:31 [auto1.de] INFO: Scrape type for UC14078: 0
2026-03-29 18:46:31 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-29 18:46:31 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-29 18:46:31 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-29 18:46:31 [auto1.de] INFO: Scrape type for BJ86438: 2
2026-03-29 18:46:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-29 18:46:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710dfe6e-ecd1-5759-b245-a32a27224915 with scrape type 2
2026-03-29 18:46:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710dfe6e-ecd1-5759-b245-a32a27224915 with scrape type 2
2026-03-29 18:46:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710dfe6e-ecd1-5759-b245-a32a27224915, identifier: BJ86438
2026-03-29 18:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-29 18:46:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-29 18:46:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438 to the API
2026-03-29 18:46:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:52Z',
'fuel_type': 'petrol',
'id': '710dfe6e-ecd1-5759-b245-a32a27224915',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ86438',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 44971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-05',
'seller_name': None,
'title': 'Dacia Duster 1.3 TCe Prestige',
'transmission': 'automatic',
'trim': 'Prestige',
'year': 2022}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Saving data for BJ86438: {'auction_closing_time': 1774883032.0, 'created_time': 1773689325.288322, 'last_price_update_time': 1774809992.128261}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ86438') HTTP/1.1" 204 0
2026-03-29 18:46:32 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Scrape type for WX24181: 2
2026-03-29 18:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-29 18:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dce4305-4e2e-592b-9d76-457ef84466cb with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dce4305-4e2e-592b-9d76-457ef84466cb with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3dce4305-4e2e-592b-9d76-457ef84466cb, identifier: WX24181
2026-03-29 18:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-29 18:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-29 18:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181 to the API
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:27:16Z',
'fuel_type': 'diesel',
'id': '3dce4305-4e2e-592b-9d76-457ef84466cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX24181',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 260478,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-30',
'seller_name': None,
'title': 'Volvo V70 2.0 D4 Black Edition',
'transmission': 'automatic',
'trim': 'Black Edition',
'year': 2015}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Saving data for WX24181: {'auction_closing_time': 1774884436.0, 'created_time': 1773136167.446759, 'last_price_update_time': 1774809992.700593}
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX24181') HTTP/1.1" 204 0
2026-03-29 18:46:32 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-29 18:46:32 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-29 18:46:32 [auto1.de] INFO: Scrape type for NP46589: 2
2026-03-29 18:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-29 18:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with scrape type 2
2026-03-29 18:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca1bcc98-8849-55f2-a537-755fbdd9d1e1, identifier: NP46589
2026-03-29 18:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-29 18:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589
2026-03-29 18:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca1bcc98-8849-55f2-a537-755fbdd9d1e1 with identifier: NP46589 to the API
2026-03-29 18:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 326,
'expiration_date': '2026-03-30T15:29:48Z',
'fuel_type': 'diesel',
'id': 'ca1bcc98-8849-55f2-a537-755fbdd9d1e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP46589',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 98865,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-13',
'seller_name': None,
'title': 'BMW X3 M40d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Saving data for NP46589: {'auction_closing_time': 1774884588.0, 'created_time': 1774521713.523712, 'last_price_update_time': 1774809993.144078}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP46589') HTTP/1.1" 204 0
2026-03-29 18:46:33 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for BM05172: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for PJ50890: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for ZY31624: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for BV38151: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for JZ77542: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for RC48761: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for LX11356: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for LD57431: 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for FN16508: 2
2026-03-29 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-29 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26d876f6-2cca-5451-bdcb-237bb64d12ec with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26d876f6-2cca-5451-bdcb-237bb64d12ec with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26d876f6-2cca-5451-bdcb-237bb64d12ec, identifier: FN16508
2026-03-29 18:46:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-29 18:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508
2026-03-29 18:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26d876f6-2cca-5451-bdcb-237bb64d12ec with identifier: FN16508 to the API
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:04Z',
'fuel_type': 'petrol',
'id': '26d876f6-2cca-5451-bdcb-237bb64d12ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN16508',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 55689,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-05',
'seller_name': None,
'title': 'BMW 1er 118i Sport Line',
'transmission': 'manual',
'trim': 'Sport Line',
'year': 2018}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Saving data for FN16508: {'auction_closing_time': 1774883884.0, 'created_time': 1774521934.83695, 'last_price_update_time': 1774809993.748233}
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN16508') HTTP/1.1" 204 0
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-29 18:46:33 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-29 18:46:33 [auto1.de] INFO: Scrape type for HX92939: 2
2026-03-29 18:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-29 18:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with scrape type 2
2026-03-29 18:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9, identifier: HX92939
2026-03-29 18:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-29 18:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939
2026-03-29 18:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6539662d-8c7b-5bda-a193-4d3fef8bb4e9 with identifier: HX92939 to the API
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:42:07Z',
'fuel_type': 'petrol',
'id': '6539662d-8c7b-5bda-a193-4d3fef8bb4e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX92939',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 184324,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-30',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Saving data for HX92939: {'auction_closing_time': 1774885327.0, 'created_time': 1774522548.282944, 'last_price_update_time': 1774809994.332598}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX92939') HTTP/1.1" 204 0
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Scrape type for MZ98399: 2
2026-03-29 18:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-29 18:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55f978b-941e-589d-a126-ef9779bc91b6 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55f978b-941e-589d-a126-ef9779bc91b6 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d55f978b-941e-589d-a126-ef9779bc91b6, identifier: MZ98399
2026-03-29 18:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-29 18:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-29 18:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399 to the API
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:54Z',
'fuel_type': 'diesel',
'id': 'd55f978b-941e-589d-a126-ef9779bc91b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ98399',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 106846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-21',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2016}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Saving data for MZ98399: {'auction_closing_time': 1774883634.0, 'created_time': 1773772625.722903, 'last_price_update_time': 1774809994.79653}
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ98399') HTTP/1.1" 204 0
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-29 18:46:34 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ27375%27 HTTP/1.1" 200 None
2026-03-29 18:46:34 [auto1.de] INFO: Scrape type for AJ27375: 2
2026-03-29 18:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375
2026-03-29 18:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f3e01a-8094-5ed4-97da-9dbe1afff589 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f3e01a-8094-5ed4-97da-9dbe1afff589 with scrape type 2
2026-03-29 18:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f3e01a-8094-5ed4-97da-9dbe1afff589, identifier: AJ27375
2026-03-29 18:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375
2026-03-29 18:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375
2026-03-29 18:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f3e01a-8094-5ed4-97da-9dbe1afff589 with identifier: AJ27375 to the API
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:50:35Z',
'fuel_type': 'hybrid',
'id': '17f3e01a-8094-5ed4-97da-9dbe1afff589',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ27375',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 62133,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-07',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2022}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ27375%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Saving data for AJ27375: {'auction_closing_time': 1774885835.0, 'created_time': 1773428534.846355, 'last_price_update_time': 1774809995.266732}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ27375') HTTP/1.1" 204 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for MA53170: 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF48816%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for MF48816: 2
2026-03-29 18:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816
2026-03-29 18:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 180e6fec-da75-5258-9054-0fd8b525d0d5 with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 180e6fec-da75-5258-9054-0fd8b525d0d5 with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 180e6fec-da75-5258-9054-0fd8b525d0d5, identifier: MF48816
2026-03-29 18:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816
2026-03-29 18:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816
2026-03-29 18:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 180e6fec-da75-5258-9054-0fd8b525d0d5 with identifier: MF48816 to the API
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:38:10Z',
'fuel_type': 'petrol',
'id': '180e6fec-da75-5258-9054-0fd8b525d0d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF48816',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 171543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-12',
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 Klassik Kollektion 2WD',
'transmission': 'manual',
'trim': 'Klassik Kollektion 2WD',
'year': 2015}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF48816%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Saving data for MF48816: {'auction_closing_time': 1774885090.0, 'created_time': 1774350628.444929, 'last_price_update_time': 1774809995.68966}
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF48816') HTTP/1.1" 204 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for NE25486: 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for TB30393: 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for EW17525: 0
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-29 18:46:35 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-29 18:46:35 [auto1.de] INFO: Scrape type for CZ36938: 2
2026-03-29 18:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-29 18:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71200441-6566-5c38-8a15-efb2f15c56dd with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71200441-6566-5c38-8a15-efb2f15c56dd with scrape type 2
2026-03-29 18:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71200441-6566-5c38-8a15-efb2f15c56dd, identifier: CZ36938
2026-03-29 18:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-29 18:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938
2026-03-29 18:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71200441-6566-5c38-8a15-efb2f15c56dd with identifier: CZ36938 to the API
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 420,
'expiration_date': '2026-03-30T15:25:55Z',
'fuel_type': 'petrol',
'id': '71200441-6566-5c38-8a15-efb2f15c56dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ36938',
'listing': 'auction',
'make': 'Ford',
'model': 'Mustang',
'odometer': 29880,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-08',
'seller_name': None,
'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2018}
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-29 18:46:36 [auto1.de] INFO: Saving data for CZ36938: {'auction_closing_time': 1774884355.0, 'created_time': 1774522562.375157, 'last_price_update_time': 1774809996.981928}
2026-03-29 18:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ36938') HTTP/1.1" 204 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for CD08059: 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for JL21750: 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for VC80296: 2
2026-03-29 18:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-29 18:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79782f7c-8fc5-5326-b805-52f47039130d with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79782f7c-8fc5-5326-b805-52f47039130d with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79782f7c-8fc5-5326-b805-52f47039130d, identifier: VC80296
2026-03-29 18:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-29 18:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-29 18:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296 to the API
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:46:11Z',
'fuel_type': 'diesel',
'id': '79782f7c-8fc5-5326-b805-52f47039130d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC80296',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 179501,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-04',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI T Avantgarde',
'transmission': 'automatic',
'trim': 'T Avantgarde',
'year': 2009}
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Saving data for VC80296: {'auction_closing_time': 1774885571.0, 'created_time': 1774608091.518063, 'last_price_update_time': 1774809997.491979}
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC80296') HTTP/1.1" 204 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for KY11260: 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for RK60330: 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for NK67833: 0
2026-03-29 18:46:37 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-29 18:46:37 [auto1.de] INFO: Scrape type for PW98263: 2
2026-03-29 18:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-29 18:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd92968-1add-585a-8ddc-05fdc08056a1 with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd92968-1add-585a-8ddc-05fdc08056a1 with scrape type 2
2026-03-29 18:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd92968-1add-585a-8ddc-05fdc08056a1, identifier: PW98263
2026-03-29 18:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-29 18:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-29 18:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263 to the API
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:14:36Z',
'fuel_type': 'petrol',
'id': '6cd92968-1add-585a-8ddc-05fdc08056a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW98263',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 119518,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-06',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2010}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Saving data for PW98263: {'auction_closing_time': 1774883676.0, 'created_time': 1773775262.30705, 'last_price_update_time': 1774809998.104994}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW98263') HTTP/1.1" 204 0
2026-03-29 18:46:38 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Scrape type for PU90892: 2
2026-03-29 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-29 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b46849-aab4-5f9b-b020-8533bb792ad0 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b46849-aab4-5f9b-b020-8533bb792ad0 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3b46849-aab4-5f9b-b020-8533bb792ad0, identifier: PU90892
2026-03-29 18:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-29 18:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892
2026-03-29 18:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3b46849-aab4-5f9b-b020-8533bb792ad0 with identifier: PU90892 to the API
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:29:03Z',
'fuel_type': 'petrol',
'id': 'd3b46849-aab4-5f9b-b020-8533bb792ad0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU90892',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 98605,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 Edition 19 Progressive',
'transmission': 'automatic',
'trim': 'Edition 19 Progressive',
'year': 2019}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Saving data for PU90892: {'auction_closing_time': 1774884543.0, 'created_time': 1774522214.393852, 'last_price_update_time': 1774809998.522134}
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU90892') HTTP/1.1" 204 0
2026-03-29 18:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:38 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:38 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-29 18:46:38 [auto1.de] INFO: Scrape type for HU72855: 2
2026-03-29 18:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-29 18:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe27f486-eb45-5680-94fb-0d6d8272d5e2 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe27f486-eb45-5680-94fb-0d6d8272d5e2 with scrape type 2
2026-03-29 18:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe27f486-eb45-5680-94fb-0d6d8272d5e2, identifier: HU72855
2026-03-29 18:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-29 18:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855
2026-03-29 18:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe27f486-eb45-5680-94fb-0d6d8272d5e2 with identifier: HU72855 to the API
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:24:14Z',
'fuel_type': 'diesel',
'id': 'fe27f486-eb45-5680-94fb-0d6d8272d5e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU72855',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 144713,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-04',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2012}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Saving data for HU72855: {'auction_closing_time': 1774884254.0, 'created_time': 1774522094.453723, 'last_price_update_time': 1774809999.020106}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU72855') HTTP/1.1" 204 0
2026-03-29 18:46:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Scrape type for WN12652: 2
2026-03-29 18:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-29 18:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baccaceb-0dfd-5a48-b66c-2ab35fcffa70, identifier: WN12652
2026-03-29 18:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-29 18:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-29 18:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652 to the API
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:53:21Z',
'fuel_type': 'petrol',
'id': 'baccaceb-0dfd-5a48-b66c-2ab35fcffa70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN12652',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 50726,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-27',
'seller_name': None,
'title': 'Fiat Panda 1.1 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2009}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Saving data for WN12652: {'auction_closing_time': 1774886001.0, 'created_time': 1773307574.059231, 'last_price_update_time': 1774809999.493321}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN12652') HTTP/1.1" 204 0
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Scrape type for VF27254: 2
2026-03-29 18:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254
2026-03-29 18:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b72ded6-c498-511a-91f1-45ebbd0be765 with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b72ded6-c498-511a-91f1-45ebbd0be765 with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b72ded6-c498-511a-91f1-45ebbd0be765, identifier: VF27254
2026-03-29 18:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254
2026-03-29 18:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254
2026-03-29 18:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b72ded6-c498-511a-91f1-45ebbd0be765 with identifier: VF27254 to the API
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:53:38Z',
'fuel_type': 'petrol',
'id': '9b72ded6-c498-511a-91f1-45ebbd0be765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF27254',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 172789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-29',
'seller_name': None,
'title': 'Volkswagen Scirocco 1.4 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Saving data for VF27254: {'auction_closing_time': 1774886018.0, 'created_time': 1773831500.767157, 'last_price_update_time': 1774809999.904804}
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF27254') HTTP/1.1" 204 0
2026-03-29 18:46:39 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-29 18:46:39 [auto1.de] INFO: Scrape type for PZ82865: 2
2026-03-29 18:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-29 18:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661c9ce5-0090-5231-9228-7a2dafd12b96 with scrape type 2
2026-03-29 18:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 661c9ce5-0090-5231-9228-7a2dafd12b96 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 661c9ce5-0090-5231-9228-7a2dafd12b96, identifier: PZ82865
2026-03-29 18:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-29 18:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-29 18:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865 to the API
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 262,
'expiration_date': '2026-03-30T15:34:29Z',
'fuel_type': 'diesel',
'id': '661c9ce5-0090-5231-9228-7a2dafd12b96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ82865',
'listing': 'auction',
'make': 'Audi',
'model': 'A8',
'odometer': 120246,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-24',
'seller_name': None,
'title': 'Audi A8 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Saving data for PZ82865: {'auction_closing_time': 1774884869.0, 'created_time': 1774265072.591874, 'last_price_update_time': 1774810000.36149}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ82865') HTTP/1.1" 204 0
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Scrape type for LT58589: 0
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Scrape type for NH12576: 2
2026-03-29 18:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-29 18:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e88df9d-87de-5d25-92dd-741ecc203953 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e88df9d-87de-5d25-92dd-741ecc203953 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e88df9d-87de-5d25-92dd-741ecc203953, identifier: NH12576
2026-03-29 18:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-29 18:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576
2026-03-29 18:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e88df9d-87de-5d25-92dd-741ecc203953 with identifier: NH12576 to the API
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:50:53Z',
'fuel_type': 'petrol',
'id': '9e88df9d-87de-5d25-92dd-741ecc203953',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH12576',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf IV',
'odometer': 142994,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-09-17',
'seller_name': None,
'title': 'Volkswagen Golf IV 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2001}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Saving data for NH12576: {'auction_closing_time': 1774885853.0, 'created_time': 1774522110.729333, 'last_price_update_time': 1774810000.864262}
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH12576') HTTP/1.1" 204 0
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-29 18:46:40 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-29 18:46:40 [auto1.de] INFO: Scrape type for HY06483: 2
2026-03-29 18:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-29 18:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd79f322-cc4e-53e8-bf86-779b1ab3d404 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd79f322-cc4e-53e8-bf86-779b1ab3d404 with scrape type 2
2026-03-29 18:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd79f322-cc4e-53e8-bf86-779b1ab3d404, identifier: HY06483
2026-03-29 18:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-29 18:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-29 18:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483 to the API
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:42:03Z',
'fuel_type': 'petrol',
'id': 'fd79f322-cc4e-53e8-bf86-779b1ab3d404',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY06483',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 194321,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-12-13',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2006}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Saving data for HY06483: {'auction_closing_time': 1774885323.0, 'created_time': 1773137885.530848, 'last_price_update_time': 1774810001.335293}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY06483') HTTP/1.1" 204 0
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Scrape type for XA54655: 2
2026-03-29 18:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-29 18:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a72215d9-4b10-55e2-8d68-63bf15d209e1 with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a72215d9-4b10-55e2-8d68-63bf15d209e1 with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a72215d9-4b10-55e2-8d68-63bf15d209e1, identifier: XA54655
2026-03-29 18:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-29 18:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655
2026-03-29 18:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a72215d9-4b10-55e2-8d68-63bf15d209e1 with identifier: XA54655 to the API
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:38:17Z',
'fuel_type': 'petrol',
'id': 'a72215d9-4b10-55e2-8d68-63bf15d209e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA54655',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 219861,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-08-29',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.6 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2005}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Saving data for XA54655: {'auction_closing_time': 1774885097.0, 'created_time': 1774522147.247987, 'last_price_update_time': 1774810001.734996}
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA54655') HTTP/1.1" 204 0
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-29 18:46:41 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-29 18:46:41 [auto1.de] INFO: Scrape type for GZ43118: 2
2026-03-29 18:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118
2026-03-29 18:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c3233e-3156-55db-9d40-7a9af9d5ef1e with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24c3233e-3156-55db-9d40-7a9af9d5ef1e with scrape type 2
2026-03-29 18:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24c3233e-3156-55db-9d40-7a9af9d5ef1e, identifier: GZ43118
2026-03-29 18:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118
2026-03-29 18:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118
2026-03-29 18:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24c3233e-3156-55db-9d40-7a9af9d5ef1e with identifier: GZ43118 to the API
2026-03-29 18:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:34Z',
'fuel_type': 'petrol',
'id': '24c3233e-3156-55db-9d40-7a9af9d5ef1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ43118',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 82714,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-11',
'seller_name': None,
'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Saving data for GZ43118: {'auction_closing_time': 1774885174.0, 'created_time': 1774034889.688054, 'last_price_update_time': 1774810002.159605}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ43118') HTTP/1.1" 204 0
2026-03-29 18:46:42 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Scrape type for DZ38540: 2
2026-03-29 18:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-29 18:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5913f35-9307-5a3c-bc15-2576acd9021d with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5913f35-9307-5a3c-bc15-2576acd9021d with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5913f35-9307-5a3c-bc15-2576acd9021d, identifier: DZ38540
2026-03-29 18:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-29 18:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540
2026-03-29 18:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5913f35-9307-5a3c-bc15-2576acd9021d with identifier: DZ38540 to the API
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:57:44Z',
'fuel_type': 'petrol',
'id': 'd5913f35-9307-5a3c-bc15-2576acd9021d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ38540',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 185402,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-30',
'seller_name': None,
'title': 'Ford C-Max 1.6 Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2007}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Saving data for DZ38540: {'auction_closing_time': 1774886264.0, 'created_time': 1774522196.066596, 'last_price_update_time': 1774810002.67843}
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ38540') HTTP/1.1" 204 0
2026-03-29 18:46:42 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-29 18:46:42 [auto1.de] INFO: Scrape type for FV94610: 2
2026-03-29 18:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-29 18:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c019b7c-8204-52b8-bc97-8858d94ee509 with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c019b7c-8204-52b8-bc97-8858d94ee509 with scrape type 2
2026-03-29 18:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c019b7c-8204-52b8-bc97-8858d94ee509, identifier: FV94610
2026-03-29 18:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-29 18:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-29 18:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610 to the API
2026-03-29 18:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:45:57Z',
'fuel_type': 'petrol',
'id': '2c019b7c-8204-52b8-bc97-8858d94ee509',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV94610',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 70628,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-19',
'seller_name': None,
'title': 'Ford Mondeo 1.5 EcoBoost Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2018}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Saving data for FV94610: {'auction_closing_time': 1774885557.0, 'created_time': 1774608260.694232, 'last_price_update_time': 1774810003.145934}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV94610') HTTP/1.1" 204 0
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Scrape type for BU32595: 2
2026-03-29 18:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595
2026-03-29 18:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f, identifier: BU32595
2026-03-29 18:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595
2026-03-29 18:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595
2026-03-29 18:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f with identifier: BU32595 to the API
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:57:11Z',
'fuel_type': 'petrol',
'id': 'a1a1b4ef-c24e-5d65-8a24-3fc0e908ff7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU32595',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 133760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-11',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Saving data for BU32595: {'auction_closing_time': 1774886231.0, 'created_time': 1774636623.265165, 'last_price_update_time': 1774810003.555569}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU32595') HTTP/1.1" 204 0
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Scrape type for PY30704: 0
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-29 18:46:43 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-29 18:46:43 [auto1.de] INFO: Scrape type for XR01056: 2
2026-03-29 18:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056
2026-03-29 18:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312dc970-afab-5ffc-8dac-9a17220f9c41 with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 312dc970-afab-5ffc-8dac-9a17220f9c41 with scrape type 2
2026-03-29 18:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 312dc970-afab-5ffc-8dac-9a17220f9c41, identifier: XR01056
2026-03-29 18:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056
2026-03-29 18:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056
2026-03-29 18:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 312dc970-afab-5ffc-8dac-9a17220f9c41 with identifier: XR01056 to the API
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:58:01Z',
'fuel_type': 'petrol',
'id': '312dc970-afab-5ffc-8dac-9a17220f9c41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR01056',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 194038,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-29',
'seller_name': None,
'title': 'Renault Megane 1.4 TCe BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2012}
2026-03-29 18:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Saving data for XR01056: {'auction_closing_time': 1774886281.0, 'created_time': 1774350495.874881, 'last_price_update_time': 1774810004.003816}
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR01056') HTTP/1.1" 204 0
2026-03-29 18:46:44 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:44 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Scrape type for XY63966: 2
2026-03-29 18:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-29 18:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b974a3-1396-528e-8784-73a9c50fee01 with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6b974a3-1396-528e-8784-73a9c50fee01 with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6b974a3-1396-528e-8784-73a9c50fee01, identifier: XY63966
2026-03-29 18:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-29 18:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-29 18:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966 to the API
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:58:25Z',
'fuel_type': 'petrol',
'id': 'd6b974a3-1396-528e-8784-73a9c50fee01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY63966',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 115376,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-25',
'seller_name': None,
'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2018}
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Saving data for XY63966: {'auction_closing_time': 1774886305.0, 'created_time': 1774608630.410285, 'last_price_update_time': 1774810004.560225}
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY63966') HTTP/1.1" 204 0
2026-03-29 18:46:44 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Scrape type for MX66491: 2
2026-03-29 18:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-29 18:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e581117a-baca-5bcb-806f-ad276e8acf31 with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e581117a-baca-5bcb-806f-ad276e8acf31 with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e581117a-baca-5bcb-806f-ad276e8acf31, identifier: MX66491
2026-03-29 18:46:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:44 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-29 18:46:44 [auto1.de] INFO: Scrape type for GY83216: 2
2026-03-29 18:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-29 18:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334798d0-b753-539d-a913-692ee571232b with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 334798d0-b753-539d-a913-692ee571232b with scrape type 2
2026-03-29 18:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 334798d0-b753-539d-a913-692ee571232b, identifier: GY83216
2026-03-29 18:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-29 18:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-29 18:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491 to the API
2026-03-29 18:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:56:17Z',
'fuel_type': 'petrol',
'id': 'e581117a-baca-5bcb-806f-ad276e8acf31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX66491',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 41093,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 220 4Matic Urban',
'transmission': 'automatic',
'trim': '4Matic Urban',
'year': 2015}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Saving data for MX66491: {'auction_closing_time': 1774886177.0, 'created_time': 1773689000.738637, 'last_price_update_time': 1774810005.13401}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX66491') HTTP/1.1" 204 0
2026-03-29 18:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-29 18:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-29 18:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216 to the API
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:04:25Z',
'fuel_type': 'diesel',
'id': '334798d0-b753-539d-a913-692ee571232b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY83216',
'listing': 'auction',
'make': 'Fiat',
'model': 'Ducato',
'odometer': 34078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-18',
'seller_name': None,
'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
'transmission': 'manual',
'trim': 'L2H2 RS: 3450 mm',
'year': 2023}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Saving data for GY83216: {'auction_closing_time': 1774883065.0, 'created_time': 1774608715.265914, 'last_price_update_time': 1774810005.464473}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY83216') HTTP/1.1" 204 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for ZY67116: 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for MM33465: 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for WY50003: 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for ZE17013: 2
2026-03-29 18:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-29 18:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with scrape type 2
2026-03-29 18:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with scrape type 2
2026-03-29 18:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8f96efe-8ba1-5dc9-8cec-76fac3d74696, identifier: ZE17013
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for GH14315: 0
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-29 18:46:45 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Scrape type for MJ16162: 0
2026-03-29 18:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-29 18:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-29 18:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013 to the API
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:17:31Z',
'fuel_type': 'petrol',
'id': 'e8f96efe-8ba1-5dc9-8cec-76fac3d74696',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE17013',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 92020,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-26',
'seller_name': None,
'title': 'Fiat 500X 1.4 Turbo S-Design City Look',
'transmission': 'automatic',
'trim': 'S-Design City Look',
'year': 2017}
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-29 18:46:45 [auto1.de] INFO: Saving data for ZE17013: {'auction_closing_time': 1774883851.0, 'created_time': 1774607951.946302, 'last_price_update_time': 1774810005.998517}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE17013') HTTP/1.1" 204 0
2026-03-29 18:46:46 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-29 18:46:46 [auto1.de] INFO: Scrape type for JK50656: 2
2026-03-29 18:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-29 18:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352a306b-7d24-5f93-8abf-09acf74faf31 with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 352a306b-7d24-5f93-8abf-09acf74faf31 with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 352a306b-7d24-5f93-8abf-09acf74faf31, identifier: JK50656
2026-03-29 18:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-29 18:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-29 18:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656 to the API
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:36:38Z',
'fuel_type': 'diesel',
'id': '352a306b-7d24-5f93-8abf-09acf74faf31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK50656',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 232981,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-27',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2011}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-29 18:46:46 [auto1.de] INFO: Saving data for JK50656: {'auction_closing_time': 1774884998.0, 'created_time': 1774251382.582754, 'last_price_update_time': 1774810006.571076}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK50656') HTTP/1.1" 204 0
2026-03-29 18:46:46 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-29 18:46:46 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-29 18:46:46 [auto1.de] INFO: Scrape type for YJ00075: 2
2026-03-29 18:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075
2026-03-29 18:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e325b690-6cc0-5e4e-9ae0-9982fafc57ca with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e325b690-6cc0-5e4e-9ae0-9982fafc57ca with scrape type 2
2026-03-29 18:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e325b690-6cc0-5e4e-9ae0-9982fafc57ca, identifier: YJ00075
2026-03-29 18:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075
2026-03-29 18:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075
2026-03-29 18:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e325b690-6cc0-5e4e-9ae0-9982fafc57ca with identifier: YJ00075 to the API
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:16:29Z',
'fuel_type': 'petrol',
'id': 'e325b690-6cc0-5e4e-9ae0-9982fafc57ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ00075',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 62979,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-09',
'seller_name': None,
'title': 'Smart fortwo 0.7 Turbo Basis pure',
'transmission': 'automatic',
'trim': 'Basis pure',
'year': 2007}
2026-03-29 18:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Saving data for YJ00075: {'auction_closing_time': 1774883789.0, 'created_time': 1774350527.47794, 'last_price_update_time': 1774810007.002195}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ00075') HTTP/1.1" 204 0
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for VN69903: 0
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for XS25100: 0
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for ZB59934: 2
2026-03-29 18:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-29 18:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 941389e8-05d9-550e-b351-8fed75360bb8 with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 941389e8-05d9-550e-b351-8fed75360bb8 with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 941389e8-05d9-550e-b351-8fed75360bb8, identifier: ZB59934
2026-03-29 18:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-29 18:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934
2026-03-29 18:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 941389e8-05d9-550e-b351-8fed75360bb8 with identifier: ZB59934 to the API
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:09:05Z',
'fuel_type': 'petrol',
'id': '941389e8-05d9-550e-b351-8fed75360bb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59934',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 73492,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-26',
'seller_name': None,
'title': 'Abarth 595 1.4 Competizione',
'transmission': 'manual',
'trim': 'Competizione',
'year': 2019}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Saving data for ZB59934: {'auction_closing_time': 1774883345.0, 'created_time': 1774521943.580163, 'last_price_update_time': 1774810007.447018}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB59934') HTTP/1.1" 204 0
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for LN23623: 2
2026-03-29 18:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-29 18:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7, identifier: LN23623
2026-03-29 18:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-29 18:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-29 18:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623 to the API
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:32:34Z',
'fuel_type': 'hybrid',
'id': '2d4ae872-bb7e-5fde-9e5f-a8712e029fb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN23623',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 76884,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-03',
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2022}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Saving data for LN23623: {'auction_closing_time': 1774884754.0, 'created_time': 1773830406.814358, 'last_price_update_time': 1774810007.925965}
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN23623') HTTP/1.1" 204 0
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-29 18:46:47 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-29 18:46:47 [auto1.de] INFO: Scrape type for NE31655: 2
2026-03-29 18:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-29 18:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9c770a-d0dd-558e-8d16-30e7b056e931 with scrape type 2
2026-03-29 18:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9c770a-d0dd-558e-8d16-30e7b056e931 with scrape type 2
2026-03-29 18:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b9c770a-d0dd-558e-8d16-30e7b056e931, identifier: NE31655
2026-03-29 18:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-29 18:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655
2026-03-29 18:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b9c770a-d0dd-558e-8d16-30e7b056e931 with identifier: NE31655 to the API
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:43:32Z',
'fuel_type': 'diesel',
'id': '7b9c770a-d0dd-558e-8d16-30e7b056e931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE31655',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 258524,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-13',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Saving data for NE31655: {'auction_closing_time': 1774885412.0, 'created_time': 1774522221.054731, 'last_price_update_time': 1774810008.387769}
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE31655') HTTP/1.1" 204 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for EW02544: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for NW02543: 0
2026-03-29 18:46:48 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-29 18:46:48 [auto1.de] INFO: Scrape type for JV68869: 2
2026-03-29 18:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-29 18:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2de161-0c17-555e-b043-9e5ef9d21310 with scrape type 2
2026-03-29 18:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e2de161-0c17-555e-b043-9e5ef9d21310 with scrape type 2
2026-03-29 18:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e2de161-0c17-555e-b043-9e5ef9d21310, identifier: JV68869
2026-03-29 18:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-29 18:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-29 18:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869 to the API
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 174,
'expiration_date': '2026-03-30T15:59:43Z',
'fuel_type': 'diesel',
'id': '7e2de161-0c17-555e-b043-9e5ef9d21310',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68869',
'listing': 'auction',
'make': 'Cadillac',
'model': 'XT4',
'odometer': 31053,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-16',
'seller_name': None,
'title': 'Cadillac XT4 350D Launch Edition 2WD',
'transmission': 'automatic',
'trim': 'Launch Edition 2WD',
'year': 2021}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Saving data for JV68869: {'auction_closing_time': 1774886383.0, 'created_time': 1774293852.557589, 'last_price_update_time': 1774810009.105117}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68869') HTTP/1.1" 204 0
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Scrape type for DX01361: 0
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Scrape type for CM27166: 0
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Scrape type for XJ97474: 2
2026-03-29 18:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-29 18:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd7d930-180b-51c7-a3dc-6c7306376516 with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd7d930-180b-51c7-a3dc-6c7306376516 with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd7d930-180b-51c7-a3dc-6c7306376516, identifier: XJ97474
2026-03-29 18:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-29 18:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-29 18:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474 to the API
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:41:11Z',
'fuel_type': 'petrol',
'id': 'acd7d930-180b-51c7-a3dc-6c7306376516',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ97474',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 161860,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-28',
'seller_name': None,
'title': 'BMW 3er 335i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2012}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Saving data for XJ97474: {'auction_closing_time': 1774885271.0, 'created_time': 1773830191.200506, 'last_price_update_time': 1774810009.604636}
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ97474') HTTP/1.1" 204 0
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-29 18:46:49 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-29 18:46:49 [auto1.de] INFO: Scrape type for RX10948: 2
2026-03-29 18:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948
2026-03-29 18:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with scrape type 2
2026-03-29 18:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85aeeaa2-b35a-5fe6-a069-f188cbc77850, identifier: RX10948
2026-03-29 18:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948
2026-03-29 18:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948
2026-03-29 18:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85aeeaa2-b35a-5fe6-a069-f188cbc77850 with identifier: RX10948 to the API
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:08:55Z',
'fuel_type': 'diesel',
'id': '85aeeaa2-b35a-5fe6-a069-f188cbc77850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX10948',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 147422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seller_name': None,
'title': 'Dacia Logan MCV 1.5 dCi Celebration',
'transmission': 'manual',
'trim': 'Celebration',
'year': 2015}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Saving data for RX10948: {'auction_closing_time': 1774883335.0, 'created_time': 1774636605.980729, 'last_price_update_time': 1774810010.037583}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX10948') HTTP/1.1" 204 0
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Scrape type for XN65057: 0
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Scrape type for ZL98433: 2
2026-03-29 18:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-29 18:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7c6c83-8cea-5593-9025-a8b9a3523c06 with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe7c6c83-8cea-5593-9025-a8b9a3523c06 with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe7c6c83-8cea-5593-9025-a8b9a3523c06, identifier: ZL98433
2026-03-29 18:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-29 18:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-29 18:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433 to the API
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:58:42Z',
'fuel_type': 'petrol',
'id': 'fe7c6c83-8cea-5593-9025-a8b9a3523c06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL98433',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 25456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-23',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TSI R-Line 4Motion',
'transmission': 'automatic',
'trim': 'R-Line 4Motion',
'year': 2023}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Saving data for ZL98433: {'auction_closing_time': 1774886322.0, 'created_time': 1774291354.381908, 'last_price_update_time': 1774810010.672672}
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL98433') HTTP/1.1" 204 0
2026-03-29 18:46:50 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-29 18:46:50 [auto1.de] INFO: Scrape type for YV35353: 2
2026-03-29 18:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-29 18:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6758c1aa-38a5-55bf-b3f4-f95362269df5 with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6758c1aa-38a5-55bf-b3f4-f95362269df5 with scrape type 2
2026-03-29 18:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6758c1aa-38a5-55bf-b3f4-f95362269df5, identifier: YV35353
2026-03-29 18:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-29 18:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-29 18:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353 to the API
2026-03-29 18:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:42:07Z',
'fuel_type': 'petrol',
'id': '6758c1aa-38a5-55bf-b3f4-f95362269df5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV35353',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 161693,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-03',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-29 18:46:51 [auto1.de] INFO: Saving data for YV35353: {'auction_closing_time': 1774885327.0, 'created_time': 1773308217.977507, 'last_price_update_time': 1774810011.894306}
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV35353') HTTP/1.1" 204 0
2026-03-29 18:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:51 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-29 18:46:51 [auto1.de] INFO: Scrape type for PC35903: 2
2026-03-29 18:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-29 18:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c61a93-29a7-57cb-a99f-b685e5dea09c with scrape type 2
2026-03-29 18:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c61a93-29a7-57cb-a99f-b685e5dea09c with scrape type 2
2026-03-29 18:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c61a93-29a7-57cb-a99f-b685e5dea09c, identifier: PC35903
2026-03-29 18:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-29 18:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-29 18:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903 to the API
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:33:43Z',
'fuel_type': 'petrol',
'id': '63c61a93-29a7-57cb-a99f-b685e5dea09c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC35903',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 88460,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-20',
'seller_name': None,
'title': 'Opel Corsa 1.4 Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2009}
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Saving data for PC35903: {'auction_closing_time': 1774884823.0, 'created_time': 1773399707.834131, 'last_price_update_time': 1774810012.359168}
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC35903') HTTP/1.1" 204 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for KY06770: 2
2026-03-29 18:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-29 18:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35a331a9-dbf4-553e-9de9-e36818d279e2 with scrape type 2
2026-03-29 18:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35a331a9-dbf4-553e-9de9-e36818d279e2 with scrape type 2
2026-03-29 18:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35a331a9-dbf4-553e-9de9-e36818d279e2, identifier: KY06770
2026-03-29 18:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-29 18:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-29 18:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770 to the API
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 194,
'expiration_date': '2026-03-30T15:47:27Z',
'fuel_type': 'diesel',
'id': '35a331a9-dbf4-553e-9de9-e36818d279e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY06770',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 86624,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-28',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2019}
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Saving data for KY06770: {'auction_closing_time': 1774885647.0, 'created_time': 1774265070.092529, 'last_price_update_time': 1774810012.815308}
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY06770') HTTP/1.1" 204 0
2026-03-29 18:46:52 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for XS93446: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for VR25014: 0
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-29 18:46:52 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-29 18:46:52 [auto1.de] INFO: Scrape type for AJ83009: 2
2026-03-29 18:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-29 18:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with scrape type 2
2026-03-29 18:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with scrape type 2
2026-03-29 18:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9, identifier: AJ83009
2026-03-29 18:46:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-29 18:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-29 18:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009 to the API
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:36:30Z',
'fuel_type': 'petrol',
'id': '86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ83009',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 99995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-02-28',
'seller_name': None,
'title': 'Ford Fiesta 1.3 Fun',
'transmission': 'manual',
'trim': 'Fun',
'year': 2006}
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Saving data for AJ83009: {'auction_closing_time': 1774884990.0, 'created_time': 1774608175.05267, 'last_price_update_time': 1774810013.285936}
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ83009') HTTP/1.1" 204 0
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Scrape type for GH20850: 0
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Scrape type for JZ38471: 0
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Scrape type for JR17394: 0
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Scrape type for XS14457: 0
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-29 18:46:53 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Scrape type for ZG28999: 2
2026-03-29 18:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-29 18:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcebea2-b840-51ca-b32c-db2785840a8c with scrape type 2
2026-03-29 18:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adcebea2-b840-51ca-b32c-db2785840a8c with scrape type 2
2026-03-29 18:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adcebea2-b840-51ca-b32c-db2785840a8c, identifier: ZG28999
2026-03-29 18:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-29 18:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-29 18:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999 to the API
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:11:14Z',
'fuel_type': 'petrol',
'id': 'adcebea2-b840-51ca-b32c-db2785840a8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG28999',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 33273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-14',
'seller_name': None,
'title': 'Volkswagen Polo 2.0 TSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2019}
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-29 18:46:53 [auto1.de] INFO: Saving data for ZG28999: {'auction_closing_time': 1774883474.0, 'created_time': 1773688203.154083, 'last_price_update_time': 1774810013.890834}
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG28999') HTTP/1.1" 204 0
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-29 18:46:54 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Scrape type for GW15546: 2
2026-03-29 18:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-29 18:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0823fb9e-2485-54fe-9110-63f89db137d2 with scrape type 2
2026-03-29 18:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0823fb9e-2485-54fe-9110-63f89db137d2 with scrape type 2
2026-03-29 18:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0823fb9e-2485-54fe-9110-63f89db137d2, identifier: GW15546
2026-03-29 18:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-29 18:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546
2026-03-29 18:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0823fb9e-2485-54fe-9110-63f89db137d2 with identifier: GW15546 to the API
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:40:54Z',
'fuel_type': 'diesel',
'id': '0823fb9e-2485-54fe-9110-63f89db137d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW15546',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 142925,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-13',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Tourneo Titanium X',
'transmission': 'automatic',
'trim': '320 L2 Tourneo Titanium X',
'year': 2021}
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-29 18:46:54 [auto1.de] INFO: Saving data for GW15546: {'auction_closing_time': 1774885254.0, 'created_time': 1774522506.929775, 'last_price_update_time': 1774810014.990102}
2026-03-29 18:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW15546') HTTP/1.1" 204 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for ND29954: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: US86443
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for BX36135: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for WA46177: 2
2026-03-29 18:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-29 18:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e3f994-8aea-5935-bc91-2b277b978b16 with scrape type 2
2026-03-29 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e3f994-8aea-5935-bc91-2b277b978b16 with scrape type 2
2026-03-29 18:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e3f994-8aea-5935-bc91-2b277b978b16, identifier: WA46177
2026-03-29 18:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-29 18:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-29 18:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177 to the API
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:47:00Z',
'fuel_type': 'diesel',
'id': '89e3f994-8aea-5935-bc91-2b277b978b16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA46177',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 317737,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-19',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2010}
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Saving data for WA46177: {'auction_closing_time': 1774885620.0, 'created_time': 1774291010.261216, 'last_price_update_time': 1774810015.479426}
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA46177') HTTP/1.1" 204 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for MF63690: 0
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-29 18:46:55 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Scrape type for DP55195: 2
2026-03-29 18:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-29 18:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c75654-15b0-5492-911c-3408f638ccf3 with scrape type 2
2026-03-29 18:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03c75654-15b0-5492-911c-3408f638ccf3 with scrape type 2
2026-03-29 18:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03c75654-15b0-5492-911c-3408f638ccf3, identifier: DP55195
2026-03-29 18:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-29 18:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195
2026-03-29 18:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03c75654-15b0-5492-911c-3408f638ccf3 with identifier: DP55195 to the API
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 212,
'expiration_date': '2026-03-30T15:52:03Z',
'fuel_type': 'diesel',
'id': '03c75654-15b0-5492-911c-3408f638ccf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP55195',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 109329,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-23',
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Wildtrak',
'year': 2020}
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-29 18:46:55 [auto1.de] INFO: Saving data for DP55195: {'auction_closing_time': 1774885923.0, 'created_time': 1773427167.223173, 'last_price_update_time': 1774810015.919834}
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP55195') HTTP/1.1" 204 0
2026-03-29 18:46:56 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-29 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-29 18:46:56 [auto1.de] INFO: Scrape type for DS08913: 0
2026-03-29 18:46:56 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-29 18:46:56 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-29 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-29 18:46:56 [auto1.de] INFO: Scrape type for VS42918: 0
2026-03-29 18:46:56 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-29 18:46:56 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-29 18:46:56 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-29 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-29 18:46:56 [auto1.de] INFO: Scrape type for FM97642: 2
2026-03-29 18:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-29 18:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6bd0256-0743-5ed8-8305-5f6b668c863b with scrape type 2
2026-03-29 18:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6bd0256-0743-5ed8-8305-5f6b668c863b with scrape type 2
2026-03-29 18:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6bd0256-0743-5ed8-8305-5f6b668c863b, identifier: FM97642
2026-03-29 18:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-29 18:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-29 18:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642 to the API
2026-03-29 18:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:00:20Z',
'fuel_type': 'petrol',
'id': 'a6bd0256-0743-5ed8-8305-5f6b668c863b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM97642',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 129504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-12',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Join',
'transmission': 'manual',
'trim': 'Join',
'year': 2018}
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-29 18:46:57 [auto1.de] INFO: Saving data for FM97642: {'auction_closing_time': 1774882820.0, 'created_time': 1773401544.413465, 'last_price_update_time': 1774810017.508551}
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM97642') HTTP/1.1" 204 0
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-29 18:46:57 [auto1.de] INFO: Scrape type for ZP95286: 0
2026-03-29 18:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:46:57 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6740 | hits on page: 40
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-29 18:46:57 [auto1.de] INFO: Scrape type for MF41479: 0
2026-03-29 18:46:57 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-29 18:46:57 [auto1.de] INFO: Scrape type for KC37462: 2
2026-03-29 18:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462
2026-03-29 18:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deabc4f7-8a95-558c-b315-2ba4f1ec8270 with scrape type 2
2026-03-29 18:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deabc4f7-8a95-558c-b315-2ba4f1ec8270 with scrape type 2
2026-03-29 18:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: deabc4f7-8a95-558c-b315-2ba4f1ec8270, identifier: KC37462
2026-03-29 18:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462
2026-03-29 18:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462
2026-03-29 18:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: deabc4f7-8a95-558c-b315-2ba4f1ec8270 with identifier: KC37462 to the API
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:18:34Z',
'fuel_type': 'petrol',
'id': 'deabc4f7-8a95-558c-b315-2ba4f1ec8270',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC37462',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 39345,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-22',
'seller_name': None,
'title': 'Opel Corsa 1.2 120 Jahre',
'transmission': 'manual',
'trim': '120 Jahre',
'year': 2019}
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-29 18:46:58 [auto1.de] INFO: Saving data for KC37462: {'auction_closing_time': 1774883914.0, 'created_time': 1774636615.2192, 'last_price_update_time': 1774810018.068627}
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC37462') HTTP/1.1" 204 0
2026-03-29 18:46:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-29 18:46:58 [auto1.de] INFO: Scrape type for XD31530: 0
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-29 18:46:58 [auto1.de] INFO: Scrape type for PP43066: 2
2026-03-29 18:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-29 18:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2239d488-0849-58ee-a1e7-739c9b060fb4 with scrape type 2
2026-03-29 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2239d488-0849-58ee-a1e7-739c9b060fb4 with scrape type 2
2026-03-29 18:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2239d488-0849-58ee-a1e7-739c9b060fb4, identifier: PP43066
2026-03-29 18:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-29 18:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-29 18:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066 to the API
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 195,
'expiration_date': '2026-03-30T15:06:55Z',
'fuel_type': 'diesel',
'id': '2239d488-0849-58ee-a1e7-739c9b060fb4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP43066',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 262535,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-14',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2016}
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-29 18:46:58 [auto1.de] INFO: Saving data for PP43066: {'auction_closing_time': 1774883215.0, 'created_time': 1774608097.238384, 'last_price_update_time': 1774810018.616569}
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP43066') HTTP/1.1" 204 0
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-29 18:46:58 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-29 18:46:58 [auto1.de] INFO: Scrape type for VJ90236: 2
2026-03-29 18:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-29 18:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with scrape type 2
2026-03-29 18:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with scrape type 2
2026-03-29 18:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa, identifier: VJ90236
2026-03-29 18:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-29 18:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-29 18:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236 to the API
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:48:09Z',
'fuel_type': 'petrol',
'id': '65ce3f8a-36b1-5e83-952b-6cfd301db4fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ90236',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 136123,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-07',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Champions Edition',
'transmission': 'manual',
'trim': 'Champions Edition',
'year': 2012}
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-29 18:46:59 [auto1.de] INFO: Saving data for VJ90236: {'auction_closing_time': 1774885689.0, 'created_time': 1774608201.391241, 'last_price_update_time': 1774810019.03335}
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ90236') HTTP/1.1" 204 0
2026-03-29 18:46:59 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-29 18:46:59 [auto1.de] INFO: Scrape type for MS86460: 2
2026-03-29 18:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-29 18:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with scrape type 2
2026-03-29 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with scrape type 2
2026-03-29 18:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d, identifier: MS86460
2026-03-29 18:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-29 18:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-29 18:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460 to the API
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:15:27Z',
'fuel_type': 'diesel',
'id': 'df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS86460',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 157618,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2016}
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-29 18:46:59 [auto1.de] INFO: Saving data for MS86460: {'auction_closing_time': 1774883727.0, 'created_time': 1773402213.553474, 'last_price_update_time': 1774810019.595324}
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS86460') HTTP/1.1" 204 0
2026-03-29 18:46:59 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-29 18:46:59 [auto1.de] INFO: Scrape type for GZ31172: 0
2026-03-29 18:46:59 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-29 18:46:59 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-29 18:46:59 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-29 18:46:59 [auto1.de] INFO: Scrape type for GU48092: 0
2026-03-29 18:46:59 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-29 18:46:59 [auto1.de] INFO: Scrape type for UT93934: 2
2026-03-29 18:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-29 18:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca787e8-bbb9-5c5e-9aad-c874b48cb593 with scrape type 2
2026-03-29 18:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eca787e8-bbb9-5c5e-9aad-c874b48cb593 with scrape type 2
2026-03-29 18:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eca787e8-bbb9-5c5e-9aad-c874b48cb593, identifier: UT93934
2026-03-29 18:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-29 18:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-29 18:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934 to the API
2026-03-29 18:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:31Z',
'fuel_type': 'petrol',
'id': 'eca787e8-bbb9-5c5e-9aad-c874b48cb593',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT93934',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 40607,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seller_name': None,
'title': 'Seat Alhambra 1.4 TSI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2022}
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-29 18:47:00 [auto1.de] INFO: Saving data for UT93934: {'auction_closing_time': 1774883971.0, 'created_time': 1773308013.532886, 'last_price_update_time': 1774810020.521492}
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT93934') HTTP/1.1" 204 0
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-29 18:47:00 [auto1.de] INFO: Scrape type for KD53590: 2
2026-03-29 18:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-29 18:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272942b6-2f4b-5344-aae6-80943da4d3bf with scrape type 2
2026-03-29 18:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 272942b6-2f4b-5344-aae6-80943da4d3bf with scrape type 2
2026-03-29 18:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 272942b6-2f4b-5344-aae6-80943da4d3bf, identifier: KD53590
2026-03-29 18:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-29 18:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590
2026-03-29 18:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 272942b6-2f4b-5344-aae6-80943da4d3bf with identifier: KD53590 to the API
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 58,
'expiration_date': '2026-03-30T15:19:51Z',
'fuel_type': 'petrol',
'id': '272942b6-2f4b-5344-aae6-80943da4d3bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD53590',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 105495,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-03-12',
'seller_name': None,
'title': 'Opel Corsa 1.0 Fresh',
'transmission': 'manual',
'trim': 'Fresh',
'year': 2002}
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-29 18:47:00 [auto1.de] INFO: Saving data for KD53590: {'auction_closing_time': 1774883991.0, 'created_time': 1774033903.950529, 'last_price_update_time': 1774810020.941357}
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD53590') HTTP/1.1" 204 0
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-29 18:47:00 [auto1.de] INFO: Scrape type for GN70453: 0
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-29 18:47:00 [auto1.de] INFO: Scrape type for WP84657: 0
2026-03-29 18:47:00 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-29 18:47:01 [auto1.de] INFO: Scrape type for WE09551: 0
2026-03-29 18:47:01 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-29 18:47:01 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-29 18:47:01 [auto1.de] INFO: Scrape type for UZ82929: 2
2026-03-29 18:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-29 18:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c with scrape type 2
2026-03-29 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c with scrape type 2
2026-03-29 18:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27bb1249-b18c-5c8c-9e08-9cae316cae5c, identifier: UZ82929
2026-03-29 18:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-29 18:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-29 18:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929 to the API
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:43:05Z',
'fuel_type': 'diesel',
'id': '27bb1249-b18c-5c8c-9e08-9cae316cae5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ82929',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 267160,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-05',
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Black Shadow 4x2',
'transmission': 'manual',
'trim': 'Black Shadow 4x2',
'year': 2016}
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-29 18:47:01 [auto1.de] INFO: Saving data for UZ82929: {'auction_closing_time': 1774885385.0, 'created_time': 1774607782.625442, 'last_price_update_time': 1774810021.439414}
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ82929') HTTP/1.1" 204 0
2026-03-29 18:47:01 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-29 18:47:01 [auto1.de] INFO: Scrape type for AU97195: 2
2026-03-29 18:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-29 18:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817227d7-5e70-55be-9ac2-af7343b89aa2 with scrape type 2
2026-03-29 18:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817227d7-5e70-55be-9ac2-af7343b89aa2 with scrape type 2
2026-03-29 18:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817227d7-5e70-55be-9ac2-af7343b89aa2, identifier: AU97195
2026-03-29 18:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-29 18:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-29 18:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195 to the API
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:08:05Z',
'fuel_type': 'petrol',
'id': '817227d7-5e70-55be-9ac2-af7343b89aa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU97195',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 26608,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-10',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2020}
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-29 18:47:01 [auto1.de] INFO: Saving data for AU97195: {'auction_closing_time': 1774883285.0, 'created_time': 1774608278.938039, 'last_price_update_time': 1774810021.996464}
2026-03-29 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU97195') HTTP/1.1" 204 0
2026-03-29 18:47:02 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-29 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-29 18:47:02 [auto1.de] INFO: Scrape type for LL81874: 2
2026-03-29 18:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-29 18:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25831bd8-eef7-5b83-a637-be43c91607ba with scrape type 2
2026-03-29 18:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25831bd8-eef7-5b83-a637-be43c91607ba with scrape type 2
2026-03-29 18:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25831bd8-eef7-5b83-a637-be43c91607ba, identifier: LL81874
2026-03-29 18:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-29 18:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-29 18:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874 to the API
2026-03-29 18:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:06:33Z',
'fuel_type': 'diesel',
'id': '25831bd8-eef7-5b83-a637-be43c91607ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL81874',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T4 Multivan',
'odometer': 409958,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1996-09-17',
'seller_name': None,
'title': 'Volkswagen T4 Multivan 2.5 TDI',
'transmission': 'manual',
'trim': '',
'year': 1996}
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-29 18:47:03 [auto1.de] INFO: Saving data for LL81874: {'auction_closing_time': 1774883193.0, 'created_time': 1773686861.975982, 'last_price_update_time': 1774810023.04136}
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL81874') HTTP/1.1" 204 0
2026-03-29 18:47:03 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-29 18:47:03 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-29 18:47:03 [auto1.de] INFO: Scrape type for EU98670: 0
2026-03-29 18:47:03 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-29 18:47:03 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-29 18:47:03 [auto1.de] INFO: Scrape type for VH71903: 2
2026-03-29 18:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-29 18:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4be3bbd5-ae53-5068-86f9-87028fff9951 with scrape type 2
2026-03-29 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4be3bbd5-ae53-5068-86f9-87028fff9951 with scrape type 2
2026-03-29 18:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4be3bbd5-ae53-5068-86f9-87028fff9951, identifier: VH71903
2026-03-29 18:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-29 18:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-29 18:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903 to the API
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:56:12Z',
'fuel_type': 'diesel',
'id': '4be3bbd5-ae53-5068-86f9-87028fff9951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH71903',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 197821,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-16',
'seller_name': None,
'title': 'BMW X1 sDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-29 18:47:03 [auto1.de] INFO: Saving data for VH71903: {'auction_closing_time': 1774886172.0, 'created_time': 1773306884.353655, 'last_price_update_time': 1774810023.499147}
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH71903') HTTP/1.1" 204 0
2026-03-29 18:47:03 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-29 18:47:03 [auto1.de] INFO: Scrape type for VH64157: 2
2026-03-29 18:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-29 18:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with scrape type 2
2026-03-29 18:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with scrape type 2
2026-03-29 18:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d3d2342-effd-5ec6-bf30-e10f98816ea0, identifier: VH64157
2026-03-29 18:47:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-29 18:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-29 18:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157 to the API
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:40:02Z',
'fuel_type': 'petrol',
'id': '6d3d2342-effd-5ec6-bf30-e10f98816ea0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH64157',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 178681,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-27',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 250 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2015}
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-29 18:47:03 [auto1.de] INFO: Saving data for VH64157: {'auction_closing_time': 1774885202.0, 'created_time': 1774292166.560878, 'last_price_update_time': 1774810023.959455}
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH64157') HTTP/1.1" 204 0
2026-03-29 18:47:03 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:03 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-29 18:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-29 18:47:04 [auto1.de] INFO: Scrape type for LG36185: 2
2026-03-29 18:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-29 18:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 591283d8-b198-55d6-a2df-cf90c3877490 with scrape type 2
2026-03-29 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 591283d8-b198-55d6-a2df-cf90c3877490 with scrape type 2
2026-03-29 18:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 591283d8-b198-55d6-a2df-cf90c3877490, identifier: LG36185
2026-03-29 18:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-29 18:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-29 18:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185 to the API
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:22:17Z',
'fuel_type': 'petrol',
'id': '591283d8-b198-55d6-a2df-cf90c3877490',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG36185',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 162440,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-31',
'seller_name': None,
'title': 'Skoda Octavia 1.6 Team Edition',
'transmission': 'manual',
'trim': 'Team Edition',
'year': 2008}
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-29 18:47:04 [auto1.de] INFO: Saving data for LG36185: {'auction_closing_time': 1774884137.0, 'created_time': 1773401981.478406, 'last_price_update_time': 1774810024.405518}
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG36185') HTTP/1.1" 204 0
2026-03-29 18:47:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:04 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-29 18:47:04 [auto1.de] INFO: Scrape type for ZH41953: 0
2026-03-29 18:47:04 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-29 18:47:04 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-29 18:47:04 [auto1.de] INFO: Scrape type for GS82653: 0
2026-03-29 18:47:04 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-29 18:47:04 [auto1.de] INFO: Scrape type for EN87643: 2
2026-03-29 18:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-29 18:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with scrape type 2
2026-03-29 18:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with scrape type 2
2026-03-29 18:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc, identifier: EN87643
2026-03-29 18:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-29 18:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-29 18:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643 to the API
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:02:25Z',
'fuel_type': 'diesel',
'id': '9c982c84-a8cd-576e-ba63-bd456b8b2ebc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN87643',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 238117,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-30',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2014}
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-29 18:47:04 [auto1.de] INFO: Saving data for EN87643: {'auction_closing_time': 1774882945.0, 'created_time': 1774608361.892529, 'last_price_update_time': 1774810024.885913}
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN87643') HTTP/1.1" 204 0
2026-03-29 18:47:04 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-29 18:47:05 [auto1.de] INFO: Scrape type for HM56533: 0
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-29 18:47:05 [auto1.de] INFO: Scrape type for DY27021: 2
2026-03-29 18:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-29 18:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with scrape type 2
2026-03-29 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with scrape type 2
2026-03-29 18:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9, identifier: DY27021
2026-03-29 18:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-29 18:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-29 18:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021 to the API
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:40:16Z',
'fuel_type': 'petrol',
'id': 'c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY27021',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 93385,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-13',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2017}
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-29 18:47:05 [auto1.de] INFO: Saving data for DY27021: {'auction_closing_time': 1774885216.0, 'created_time': 1774607848.818762, 'last_price_update_time': 1774810025.447569}
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY27021') HTTP/1.1" 204 0
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-29 18:47:05 [auto1.de] INFO: Scrape type for LL85069: 0
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-29 18:47:05 [auto1.de] INFO: Scrape type for EG81564: 0
2026-03-29 18:47:05 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-29 18:47:05 [auto1.de] INFO: Scrape type for RV94916: 2
2026-03-29 18:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-29 18:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with scrape type 2
2026-03-29 18:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with scrape type 2
2026-03-29 18:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d, identifier: RV94916
2026-03-29 18:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-29 18:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-29 18:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916 to the API
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:00:18Z',
'fuel_type': 'petrol',
'id': 'c14711c9-e4f8-5529-9c11-dbeca5fc1b4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV94916',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 138725,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-27',
'seller_name': None,
'title': 'Volkswagen Scirocco 1.4 TSI Life BlueMotion',
'transmission': 'manual',
'trim': 'Life BlueMotion',
'year': 2013}
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-29 18:47:05 [auto1.de] INFO: Saving data for RV94916: {'auction_closing_time': 1774882818.0, 'created_time': 1773307705.810263, 'last_price_update_time': 1774810025.954842}
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV94916') HTTP/1.1" 204 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for JZ63393: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for XX23158: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for BS60844: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for GW98108: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for XJ99289: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for VP61348: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for CY66130: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for NZ21452: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for VM53714: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for KH87635: 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN51585%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for FN51585: 2
2026-03-29 18:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585
2026-03-29 18:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eb1b848-3324-5aad-a739-f78dd49fa128 with scrape type 2
2026-03-29 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eb1b848-3324-5aad-a739-f78dd49fa128 with scrape type 2
2026-03-29 18:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eb1b848-3324-5aad-a739-f78dd49fa128, identifier: FN51585
2026-03-29 18:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585
2026-03-29 18:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585
2026-03-29 18:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eb1b848-3324-5aad-a739-f78dd49fa128 with identifier: FN51585 to the API
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:28:13Z',
'fuel_type': 'petrol',
'id': '3eb1b848-3324-5aad-a739-f78dd49fa128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN51585',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 90094,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-08',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2015}
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN51585%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Saving data for FN51585: {'auction_closing_time': 1774884493.0, 'created_time': 1774723347.911344, 'last_price_update_time': 1774810026.624623}
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN51585') HTTP/1.1" 204 0
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-29 18:47:06 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-29 18:47:06 [auto1.de] INFO: Scrape type for AE67956: 2
2026-03-29 18:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-29 18:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73b37455-c58b-5a18-9e16-099c2dd454f2 with scrape type 2
2026-03-29 18:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73b37455-c58b-5a18-9e16-099c2dd454f2 with scrape type 2
2026-03-29 18:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73b37455-c58b-5a18-9e16-099c2dd454f2, identifier: AE67956
2026-03-29 18:47:06 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 10 pages/min), scraped 1213 items (at 110 items/min)
2026-03-29 18:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-29 18:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-29 18:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956 to the API
2026-03-29 18:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:02:50Z',
'fuel_type': 'petrol',
'id': '73b37455-c58b-5a18-9e16-099c2dd454f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE67956',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 140187,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Cup BlueMotion Tech',
'transmission': 'manual',
'trim': 'Cup BlueMotion Tech',
'year': 2014}
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-29 18:47:07 [auto1.de] INFO: Saving data for AE67956: {'auction_closing_time': 1774882970.0, 'created_time': 1774263628.220745, 'last_price_update_time': 1774810027.998697}
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE67956') HTTP/1.1" 204 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for PB15916: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for DA58180: 0
2026-03-29 18:47:08 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Scrape type for NA39997: 2
2026-03-29 18:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-29 18:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with scrape type 2
2026-03-29 18:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with scrape type 2
2026-03-29 18:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3, identifier: NA39997
2026-03-29 18:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-29 18:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-29 18:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997 to the API
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:55:12Z',
'fuel_type': 'petrol',
'id': '953fa758-7e5a-5ae5-ab72-fa71fec34dd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA39997',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 116813,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-24',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Team',
'transmission': 'manual',
'trim': 'Team',
'year': 2010}
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-29 18:47:08 [auto1.de] INFO: Saving data for NA39997: {'auction_closing_time': 1774886112.0, 'created_time': 1773303371.600227, 'last_price_update_time': 1774810028.489504}
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA39997') HTTP/1.1" 204 0
2026-03-29 18:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:17 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:17 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-29 18:47:17 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-29 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-29 18:47:17 [auto1.de] INFO: Scrape type for SR34905: 2
2026-03-29 18:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-29 18:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f63e23b5-1882-5871-b246-011db2b0e393 with scrape type 2
2026-03-29 18:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f63e23b5-1882-5871-b246-011db2b0e393 with scrape type 2
2026-03-29 18:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f63e23b5-1882-5871-b246-011db2b0e393, identifier: SR34905
2026-03-29 18:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-29 18:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-29 18:47:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 18:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-29 18:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905 to the API
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'purple',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:35:12Z',
'fuel_type': 'diesel',
'id': 'f63e23b5-1882-5871-b246-011db2b0e393',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR34905',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 263024,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-08',
'seller_name': None,
'title': 'Audi A5 Sportback 2.7 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-29 18:47:18 [auto1.de] INFO: Saving data for SR34905: {'auction_closing_time': 1774884912.0, 'created_time': 1773306502.164623, 'last_price_update_time': 1774810038.417659}
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR34905') HTTP/1.1" 204 0
2026-03-29 18:47:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:18 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-29 18:47:18 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-29 18:47:18 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-29 18:47:18 [auto1.de] INFO: Scrape type for XR30933: 2
2026-03-29 18:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-29 18:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with scrape type 2
2026-03-29 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with scrape type 2
2026-03-29 18:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e, identifier: XR30933
2026-03-29 18:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-29 18:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933
2026-03-29 18:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62d4e062-82c8-5091-a3ab-fcbf0a3ee14e with identifier: XR30933 to the API
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:43:13Z',
'fuel_type': 'petrol',
'id': '62d4e062-82c8-5091-a3ab-fcbf0a3ee14e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR30933',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 103570,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-07',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT ACT',
'transmission': 'manual',
'trim': 'ACT',
'year': 2018}
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-29 18:47:18 [auto1.de] INFO: Saving data for XR30933: {'auction_closing_time': 1774885393.0, 'created_time': 1774521546.322635, 'last_price_update_time': 1774810038.82166}
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR30933') HTTP/1.1" 204 0
2026-03-29 18:47:18 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-29 18:47:18 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-29 18:47:18 [auto1.de] INFO: Scrape type for ZF73856: 0
2026-03-29 18:47:18 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-29 18:47:18 [auto1.de] INFO: Scrape type for MK56565: 0
2026-03-29 18:47:18 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-29 18:47:18 [auto1.de] INFO: Scrape type for ME72354: 2
2026-03-29 18:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-29 18:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e41024-7e1d-5e66-ba7a-72a80db254ec with scrape type 2
2026-03-29 18:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25e41024-7e1d-5e66-ba7a-72a80db254ec with scrape type 2
2026-03-29 18:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25e41024-7e1d-5e66-ba7a-72a80db254ec, identifier: ME72354
2026-03-29 18:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-29 18:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354
2026-03-29 18:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25e41024-7e1d-5e66-ba7a-72a80db254ec with identifier: ME72354 to the API
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:37:42Z',
'fuel_type': 'petrol',
'id': '25e41024-7e1d-5e66-ba7a-72a80db254ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME72354',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 167119,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2019}
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-29 18:47:19 [auto1.de] INFO: Saving data for ME72354: {'auction_closing_time': 1774885062.0, 'created_time': 1774522028.888157, 'last_price_update_time': 1774810039.378321}
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME72354') HTTP/1.1" 204 0
2026-03-29 18:47:19 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-29 18:47:19 [auto1.de] INFO: Scrape type for BZ79041: 0
2026-03-29 18:47:19 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-29 18:47:19 [auto1.de] INFO: Scrape type for KV52621: 2
2026-03-29 18:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-29 18:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with scrape type 2
2026-03-29 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with scrape type 2
2026-03-29 18:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd5ebeff-de36-58b5-919c-e1f530f0f5c2, identifier: KV52621
2026-03-29 18:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-29 18:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-29 18:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621 to the API
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:59:02Z',
'fuel_type': 'petrol',
'id': 'dd5ebeff-de36-58b5-919c-e1f530f0f5c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV52621',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 171478,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-28',
'seller_name': None,
'title': 'Fiat Punto Evo 1.4 Dynamic',
'transmission': 'automatic',
'trim': 'Dynamic',
'year': 2011}
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-29 18:47:19 [auto1.de] INFO: Saving data for KV52621: {'auction_closing_time': 1774886342.0, 'created_time': 1774291108.598519, 'last_price_update_time': 1774810039.827894}
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV52621') HTTP/1.1" 204 0
2026-03-29 18:47:19 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-29 18:47:19 [auto1.de] INFO: Scrape type for SW13301: 2
2026-03-29 18:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-29 18:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d880e6f2-28da-5561-8baf-8ededeb56ad6 with scrape type 2
2026-03-29 18:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d880e6f2-28da-5561-8baf-8ededeb56ad6 with scrape type 2
2026-03-29 18:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d880e6f2-28da-5561-8baf-8ededeb56ad6, identifier: SW13301
2026-03-29 18:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-29 18:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301
2026-03-29 18:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d880e6f2-28da-5561-8baf-8ededeb56ad6 with identifier: SW13301 to the API
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:51:35Z',
'fuel_type': 'diesel',
'id': 'd880e6f2-28da-5561-8baf-8ededeb56ad6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW13301',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 109395,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-11',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2017}
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Saving data for SW13301: {'auction_closing_time': 1774885895.0, 'created_time': 1773427596.809157, 'last_price_update_time': 1774810040.234247}
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW13301') HTTP/1.1" 204 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for ER51805: 2
2026-03-29 18:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-29 18:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d39367-cd17-51f1-a41e-d7c8af251282 with scrape type 2
2026-03-29 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9d39367-cd17-51f1-a41e-d7c8af251282 with scrape type 2
2026-03-29 18:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9d39367-cd17-51f1-a41e-d7c8af251282, identifier: ER51805
2026-03-29 18:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-29 18:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-29 18:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805 to the API
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:42:42Z',
'fuel_type': 'petrol',
'id': 'f9d39367-cd17-51f1-a41e-d7c8af251282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER51805',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 43542,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-28',
'seller_name': None,
'title': 'Renault Clio 0.9 Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2018}
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Saving data for ER51805: {'auction_closing_time': 1774885362.0, 'created_time': 1773383159.346075, 'last_price_update_time': 1774810040.689908}
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER51805') HTTP/1.1" 204 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for SS31762: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for FN01227: 0
2026-03-29 18:47:20 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-29 18:47:20 [auto1.de] INFO: Scrape type for BX26482: 2
2026-03-29 18:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-29 18:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aabf142f-a197-52d1-b793-4cde5c00fb96 with scrape type 2
2026-03-29 18:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aabf142f-a197-52d1-b793-4cde5c00fb96 with scrape type 2
2026-03-29 18:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aabf142f-a197-52d1-b793-4cde5c00fb96, identifier: BX26482
2026-03-29 18:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-29 18:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482
2026-03-29 18:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aabf142f-a197-52d1-b793-4cde5c00fb96 with identifier: BX26482 to the API
2026-03-29 18:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:27:34Z',
'fuel_type': 'diesel',
'id': 'aabf142f-a197-52d1-b793-4cde5c00fb96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX26482',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 142514,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-29',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 220 CDI BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2014}
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Saving data for BX26482: {'auction_closing_time': 1774884454.0, 'created_time': 1773946491.170855, 'last_price_update_time': 1774810041.137035}
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX26482') HTTP/1.1" 204 0
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Scrape type for RC49554: 2
2026-03-29 18:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-29 18:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca620246-94fc-52d2-85f0-43551625c43c with scrape type 2
2026-03-29 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca620246-94fc-52d2-85f0-43551625c43c with scrape type 2
2026-03-29 18:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca620246-94fc-52d2-85f0-43551625c43c, identifier: RC49554
2026-03-29 18:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-29 18:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-29 18:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554 to the API
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:07:00Z',
'fuel_type': 'petrol',
'id': 'ca620246-94fc-52d2-85f0-43551625c43c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC49554',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 215543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-30',
'seller_name': None,
'title': 'Volkswagen Touran 1.2 TSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2013}
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Saving data for RC49554: {'auction_closing_time': 1774883220.0, 'created_time': 1774608181.587662, 'last_price_update_time': 1774810041.680752}
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC49554') HTTP/1.1" 204 0
2026-03-29 18:47:21 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-29 18:47:21 [auto1.de] INFO: Scrape type for RA95780: 2
2026-03-29 18:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780
2026-03-29 18:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d12e87e-8614-59fd-8dab-0a44a48b0530 with scrape type 2
2026-03-29 18:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d12e87e-8614-59fd-8dab-0a44a48b0530 with scrape type 2
2026-03-29 18:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d12e87e-8614-59fd-8dab-0a44a48b0530, identifier: RA95780
2026-03-29 18:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780
2026-03-29 18:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780
2026-03-29 18:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780 to the API
2026-03-29 18:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 557,
'expiration_date': '2026-03-30T15:04:48Z',
'fuel_type': 'petrol',
'id': '0d12e87e-8614-59fd-8dab-0a44a48b0530',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA95780',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GL-Klasse',
'odometer': 168594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-09-17',
'seller_name': None,
'title': 'Mercedes-Benz GL-Klasse GL 63 AMG 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2014}
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Saving data for RA95780: {'auction_closing_time': 1774883088.0, 'created_time': 1774510548.318218, 'last_price_update_time': 1774810042.134014}
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA95780') HTTP/1.1" 204 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for MK04993: 2
2026-03-29 18:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-29 18:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with scrape type 2
2026-03-29 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with scrape type 2
2026-03-29 18:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bc3b66c-4eee-50e6-8696-fbd62b006d81, identifier: MK04993
2026-03-29 18:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-29 18:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-29 18:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993 to the API
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:07:49Z',
'fuel_type': 'diesel',
'id': '3bc3b66c-4eee-50e6-8696-fbd62b006d81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK04993',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 322462,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-21',
'seller_name': None,
'title': 'Skoda Yeti 2.0 TDI Active Plus Edition',
'transmission': 'manual',
'trim': 'Active Plus Edition',
'year': 2012}
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Saving data for MK04993: {'auction_closing_time': 1774883269.0, 'created_time': 1773303164.589758, 'last_price_update_time': 1774810042.574036}
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK04993') HTTP/1.1" 204 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for VR01853: 0
2026-03-29 18:47:22 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-29 18:47:22 [auto1.de] INFO: Scrape type for CW50467: 2
2026-03-29 18:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-29 18:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df07608e-c87f-5488-a469-d61f37992642 with scrape type 2
2026-03-29 18:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df07608e-c87f-5488-a469-d61f37992642 with scrape type 2
2026-03-29 18:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df07608e-c87f-5488-a469-d61f37992642, identifier: CW50467
2026-03-29 18:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-29 18:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-29 18:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467 to the API
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:59:26Z',
'fuel_type': 'petrol',
'id': 'df07608e-c87f-5488-a469-d61f37992642',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW50467',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 281116,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-11',
'seller_name': None,
'title': 'Toyota Avensis 1.6',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Saving data for CW50467: {'auction_closing_time': 1774886366.0, 'created_time': 1774291204.065733, 'last_price_update_time': 1774810043.027928}
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW50467') HTTP/1.1" 204 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for FJ09626: 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for LJ58036: 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for UL59525: 2
2026-03-29 18:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-29 18:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with scrape type 2
2026-03-29 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with scrape type 2
2026-03-29 18:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862, identifier: UL59525
2026-03-29 18:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-29 18:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-29 18:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525 to the API
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:12:40Z',
'fuel_type': 'diesel',
'id': '4b0dc56a-d463-5dcc-9dc1-2355f79b7862',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL59525',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 354078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-27',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Trendline',
'transmission': 'automatic',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Saving data for UL59525: {'auction_closing_time': 1774883560.0, 'created_time': 1773946710.247724, 'last_price_update_time': 1774810043.506098}
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL59525') HTTP/1.1" 204 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for HH06694: 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for GH08686: 0
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-29 18:47:23 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Scrape type for EV68047: 2
2026-03-29 18:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047
2026-03-29 18:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8641ebe-4be8-5c63-8c05-0f233487fd62 with scrape type 2
2026-03-29 18:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8641ebe-4be8-5c63-8c05-0f233487fd62 with scrape type 2
2026-03-29 18:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8641ebe-4be8-5c63-8c05-0f233487fd62, identifier: EV68047
2026-03-29 18:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047
2026-03-29 18:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047
2026-03-29 18:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8641ebe-4be8-5c63-8c05-0f233487fd62 with identifier: EV68047 to the API
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:17:30Z',
'fuel_type': 'diesel',
'id': 'c8641ebe-4be8-5c63-8c05-0f233487fd62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV68047',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 33796,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-29 18:47:23 [auto1.de] INFO: Saving data for EV68047: {'auction_closing_time': 1774883850.0, 'created_time': 1774350703.359221, 'last_price_update_time': 1774810043.93144}
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV68047') HTTP/1.1" 204 0
2026-03-29 18:47:24 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for GR02584: 2
2026-03-29 18:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584
2026-03-29 18:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cd12f7-1491-55b8-af73-6955e585f4d8 with scrape type 2
2026-03-29 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02cd12f7-1491-55b8-af73-6955e585f4d8 with scrape type 2
2026-03-29 18:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02cd12f7-1491-55b8-af73-6955e585f4d8, identifier: GR02584
2026-03-29 18:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584
2026-03-29 18:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584
2026-03-29 18:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02cd12f7-1491-55b8-af73-6955e585f4d8 with identifier: GR02584 to the API
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:20:10Z',
'fuel_type': 'diesel',
'id': '02cd12f7-1491-55b8-af73-6955e585f4d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR02584',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Cruze',
'odometer': 169504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-29',
'seller_name': None,
'title': 'Chevrolet Cruze 2.0 Diesel LT',
'transmission': 'manual',
'trim': 'LT',
'year': 2013}
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Saving data for GR02584: {'auction_closing_time': 1774884010.0, 'created_time': 1773306173.158542, 'last_price_update_time': 1774810044.441376}
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR02584') HTTP/1.1" 204 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for FR95379: 2
2026-03-29 18:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-29 18:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with scrape type 2
2026-03-29 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with scrape type 2
2026-03-29 18:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a, identifier: FR95379
2026-03-29 18:47:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for MT67219: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for VV90195: 0
2026-03-29 18:47:24 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-29 18:47:24 [auto1.de] INFO: Scrape type for NL93561: 2
2026-03-29 18:47:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-29 18:47:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with scrape type 2
2026-03-29 18:47:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with scrape type 2
2026-03-29 18:47:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed, identifier: NL93561
2026-03-29 18:47:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-29 18:47:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-29 18:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379 to the API
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:49:36Z',
'fuel_type': 'diesel',
'id': 'ff2c81ee-9d17-52bc-8cfd-2ab00979e48a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR95379',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 255205,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-31',
'seller_name': None,
'title': 'Peugeot 308 1.6 e-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2013}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Saving data for FR95379: {'auction_closing_time': 1774885776.0, 'created_time': 1774607871.525974, 'last_price_update_time': 1774810045.040754}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR95379') HTTP/1.1" 204 0
2026-03-29 18:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-29 18:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561
2026-03-29 18:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4daa08b9-1ffe-5e58-bbb6-763aeb4137ed with identifier: NL93561 to the API
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:50:13Z',
'fuel_type': 'diesel',
'id': '4daa08b9-1ffe-5e58-bbb6-763aeb4137ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL93561',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 142410,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-14',
'seller_name': None,
'title': 'Ford Fiesta 1.4 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2012}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Saving data for NL93561: {'auction_closing_time': 1774885813.0, 'created_time': 1774521904.825234, 'last_price_update_time': 1774810045.332966}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL93561') HTTP/1.1" 204 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for HK09580: 2
2026-03-29 18:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580
2026-03-29 18:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69015933-67e2-53fd-91e7-12c58f237cc1 with scrape type 2
2026-03-29 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69015933-67e2-53fd-91e7-12c58f237cc1 with scrape type 2
2026-03-29 18:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69015933-67e2-53fd-91e7-12c58f237cc1, identifier: HK09580
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for ED94101: 0
2026-03-29 18:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580
2026-03-29 18:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580
2026-03-29 18:47:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69015933-67e2-53fd-91e7-12c58f237cc1 with identifier: HK09580 to the API
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:36:14Z',
'fuel_type': 'diesel',
'id': '69015933-67e2-53fd-91e7-12c58f237cc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK09580',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 107901,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-24',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2012}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Saving data for HK09580: {'auction_closing_time': 1774884974.0, 'created_time': 1774350842.702096, 'last_price_update_time': 1774810045.747015}
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK09580') HTTP/1.1" 204 0
2026-03-29 18:47:25 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-29 18:47:25 [auto1.de] INFO: Scrape type for KP72135: 2
2026-03-29 18:47:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-29 18:47:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13bf739-275b-5dcd-b228-9a5c2ebfe20e with scrape type 2
2026-03-29 18:47:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d13bf739-275b-5dcd-b228-9a5c2ebfe20e with scrape type 2
2026-03-29 18:47:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d13bf739-275b-5dcd-b228-9a5c2ebfe20e, identifier: KP72135
2026-03-29 18:47:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-29 18:47:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-29 18:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135 to the API
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:20:31Z',
'fuel_type': 'petrol',
'id': 'd13bf739-275b-5dcd-b228-9a5c2ebfe20e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP72135',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 79414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-30',
'seller_name': None,
'title': 'Dacia Lodgy 1.2 TCe Stepway',
'transmission': 'manual',
'trim': 'Stepway',
'year': 2018}
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Saving data for KP72135: {'auction_closing_time': 1774884031.0, 'created_time': 1773398843.753394, 'last_price_update_time': 1774810046.289786}
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP72135') HTTP/1.1" 204 0
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Scrape type for SG08680: 0
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Scrape type for HG24809: 0
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Scrape type for XP92221: 0
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Scrape type for BH21613: 2
2026-03-29 18:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-29 18:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with scrape type 2
2026-03-29 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with scrape type 2
2026-03-29 18:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909, identifier: BH21613
2026-03-29 18:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-29 18:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613
2026-03-29 18:47:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39d2b4b5-6ff9-5f5e-945e-cb10f714a909 with identifier: BH21613 to the API
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:24:15Z',
'fuel_type': 'petrol',
'id': '39d2b4b5-6ff9-5f5e-945e-cb10f714a909',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH21613',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 150812,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-04',
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2014}
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Saving data for BH21613: {'auction_closing_time': 1774884255.0, 'created_time': 1773429673.28189, 'last_price_update_time': 1774810046.75774}
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH21613') HTTP/1.1" 204 0
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Scrape type for LL82276: 0
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Scrape type for AB05978: 0
2026-03-29 18:47:26 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-29 18:47:26 [auto1.de] INFO: Scrape type for ZL89473: 2
2026-03-29 18:47:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-29 18:47:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429368c5-16de-5572-8779-c6f458c850bd with scrape type 2
2026-03-29 18:47:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 429368c5-16de-5572-8779-c6f458c850bd with scrape type 2
2026-03-29 18:47:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 429368c5-16de-5572-8779-c6f458c850bd, identifier: ZL89473
2026-03-29 18:47:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-29 18:47:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-29 18:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473 to the API
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:49:12Z',
'fuel_type': 'petrol',
'id': '429368c5-16de-5572-8779-c6f458c850bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL89473',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 130768,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-29 18:47:27 [auto1.de] INFO: Saving data for ZL89473: {'auction_closing_time': 1774885752.0, 'created_time': 1773861339.839585, 'last_price_update_time': 1774810047.22335}
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL89473') HTTP/1.1" 204 0
2026-03-29 18:47:27 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-29 18:47:27 [auto1.de] INFO: Scrape type for GN37925: 0
2026-03-29 18:47:27 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-29 18:47:27 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-29 18:47:27 [auto1.de] INFO: Scrape type for BX27927: 0
2026-03-29 18:47:27 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-29 18:47:27 [auto1.de] INFO: Scrape type for BX19940: 2
2026-03-29 18:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-29 18:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6120ca4d-e562-5530-917a-baaf953ba8b2 with scrape type 2
2026-03-29 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6120ca4d-e562-5530-917a-baaf953ba8b2 with scrape type 2
2026-03-29 18:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6120ca4d-e562-5530-917a-baaf953ba8b2, identifier: BX19940
2026-03-29 18:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-29 18:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940
2026-03-29 18:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6120ca4d-e562-5530-917a-baaf953ba8b2 with identifier: BX19940 to the API
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:08:10Z',
'fuel_type': 'petrol',
'id': '6120ca4d-e562-5530-917a-baaf953ba8b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX19940',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 117789,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-09-12',
'seller_name': None,
'title': 'Renault Scenic 1.6 Avantage',
'transmission': 'automatic',
'trim': 'Avantage',
'year': 2006}
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-29 18:47:27 [auto1.de] INFO: Saving data for BX19940: {'auction_closing_time': 1774883290.0, 'created_time': 1774522260.547889, 'last_price_update_time': 1774810047.767449}
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX19940') HTTP/1.1" 204 0
2026-03-29 18:47:27 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-29 18:47:27 [auto1.de] INFO: Scrape type for WS31989: 2
2026-03-29 18:47:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989
2026-03-29 18:47:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf50a9fe-f6a6-5698-98aa-e41f0f508792 with scrape type 2
2026-03-29 18:47:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf50a9fe-f6a6-5698-98aa-e41f0f508792 with scrape type 2
2026-03-29 18:47:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf50a9fe-f6a6-5698-98aa-e41f0f508792, identifier: WS31989
2026-03-29 18:47:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989
2026-03-29 18:47:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989
2026-03-29 18:47:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf50a9fe-f6a6-5698-98aa-e41f0f508792 with identifier: WS31989 to the API
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 121,
'expiration_date': '2026-03-30T15:47:47Z',
'fuel_type': 'petrol',
'id': 'bf50a9fe-f6a6-5698-98aa-e41f0f508792',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS31989',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 20356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-28',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Skyactiv-G',
'transmission': 'manual',
'trim': '',
'year': 2021}
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Saving data for WS31989: {'auction_closing_time': 1774885667.0, 'created_time': 1774550129.401332, 'last_price_update_time': 1774810048.191825}
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS31989') HTTP/1.1" 204 0
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Scrape type for SB81454: 2
2026-03-29 18:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-29 18:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa22120-cf3a-51f8-b850-1de84f4d2282 with scrape type 2
2026-03-29 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa22120-cf3a-51f8-b850-1de84f4d2282 with scrape type 2
2026-03-29 18:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa22120-cf3a-51f8-b850-1de84f4d2282, identifier: SB81454
2026-03-29 18:47:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-29 18:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-29 18:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454 to the API
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:52:21Z',
'fuel_type': 'diesel',
'id': 'faa22120-cf3a-51f8-b850-1de84f4d2282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB81454',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLK-Klasse',
'odometer': 99844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-12-13',
'seller_name': None,
'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
'transmission': 'automatic',
'trim': '4Matic BlueEfficiency',
'year': 2010}
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Saving data for SB81454: {'auction_closing_time': 1774885941.0, 'created_time': 1773946316.304271, 'last_price_update_time': 1774810048.643753}
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB81454') HTTP/1.1" 204 0
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Scrape type for MD58686: 0
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Scrape type for LR15690: 0
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Scrape type for SG38319: 0
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Scrape type for DZ84842: 0
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-29 18:47:28 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-29 18:47:28 [auto1.de] INFO: Scrape type for PR96123: 2
2026-03-29 18:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-29 18:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a7e94c-3b2b-5aee-9380-d9926191415f with scrape type 2
2026-03-29 18:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a7e94c-3b2b-5aee-9380-d9926191415f with scrape type 2
2026-03-29 18:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a7e94c-3b2b-5aee-9380-d9926191415f, identifier: PR96123
2026-03-29 18:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-29 18:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-29 18:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123 to the API
2026-03-29 18:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:56:14Z',
'fuel_type': 'diesel',
'id': '13a7e94c-3b2b-5aee-9380-d9926191415f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR96123',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 158464,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-19',
'seller_name': None,
'title': 'Mercedes-Benz Vito 114 CDI lang',
'transmission': 'manual',
'trim': 'lang',
'year': 2016}
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-29 18:47:29 [auto1.de] INFO: Saving data for PR96123: {'auction_closing_time': 1774886174.0, 'created_time': 1773305144.233712, 'last_price_update_time': 1774810049.223206}
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR96123') HTTP/1.1" 204 0
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-29 18:47:29 [auto1.de] INFO: Scrape type for FV65723: 0
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-29 18:47:29 [auto1.de] INFO: Scrape type for KS57096: 0
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-29 18:47:29 [auto1.de] INFO: Scrape type for AR79819: 2
2026-03-29 18:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-29 18:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with scrape type 2
2026-03-29 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with scrape type 2
2026-03-29 18:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f48bcb96-79e0-5a94-aa7e-0b74b41c6676, identifier: AR79819
2026-03-29 18:47:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-29 18:47:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-29 18:47:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819 to the API
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:56:52Z',
'fuel_type': 'diesel',
'id': 'f48bcb96-79e0-5a94-aa7e-0b74b41c6676',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR79819',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 201775,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-11',
'seller_name': None,
'title': 'Skoda Fabia 1.6 TDI Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2012}
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-29 18:47:29 [auto1.de] INFO: Saving data for AR79819: {'auction_closing_time': 1774886212.0, 'created_time': 1773831137.132372, 'last_price_update_time': 1774810049.843607}
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR79819') HTTP/1.1" 204 0
2026-03-29 18:47:29 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-29 18:47:29 [auto1.de] INFO: Scrape type for GE53934: 0
2026-03-29 18:47:29 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-29 18:47:29 [auto1.de] INFO: Scrape type for MZ82429: 2
2026-03-29 18:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-29 18:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with scrape type 2
2026-03-29 18:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with scrape type 2
2026-03-29 18:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1, identifier: MZ82429
2026-03-29 18:47:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-29 18:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-29 18:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429 to the API
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 174,
'expiration_date': '2026-03-30T15:52:38Z',
'fuel_type': 'diesel',
'id': '743b2873-ad5e-50b7-b75d-7ce5fa0325e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ82429',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 62985,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-18',
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2022}
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-29 18:47:30 [auto1.de] INFO: Saving data for MZ82429: {'auction_closing_time': 1774885958.0, 'created_time': 1773819352.587743, 'last_price_update_time': 1774810050.33421}
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ82429') HTTP/1.1" 204 0
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-29 18:47:30 [auto1.de] INFO: Scrape type for GX10720: 2
2026-03-29 18:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-29 18:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ac3892-ede8-5be1-853a-840a83d82e17 with scrape type 2
2026-03-29 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ac3892-ede8-5be1-853a-840a83d82e17 with scrape type 2
2026-03-29 18:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ac3892-ede8-5be1-853a-840a83d82e17, identifier: GX10720
2026-03-29 18:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-29 18:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-29 18:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720 to the API
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:45:07Z',
'fuel_type': 'petrol',
'id': '72ac3892-ede8-5be1-853a-840a83d82e17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX10720',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 124543,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-13',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2014}
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-29 18:47:30 [auto1.de] INFO: Saving data for GX10720: {'auction_closing_time': 1774885507.0, 'created_time': 1773301478.649371, 'last_price_update_time': 1774810050.897909}
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX10720') HTTP/1.1" 204 0
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-29 18:47:30 [auto1.de] INFO: Scrape type for UB05903: 0
2026-03-29 18:47:30 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-29 18:47:30 [auto1.de] INFO: Scrape type for KA14077: 2
2026-03-29 18:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077
2026-03-29 18:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with scrape type 2
2026-03-29 18:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with scrape type 2
2026-03-29 18:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 559abe04-f112-56c1-ae19-f18b3a0c8bf3, identifier: KA14077
2026-03-29 18:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077
2026-03-29 18:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077
2026-03-29 18:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 559abe04-f112-56c1-ae19-f18b3a0c8bf3 with identifier: KA14077 to the API
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:17:03Z',
'fuel_type': 'diesel',
'id': '559abe04-f112-56c1-ae19-f18b3a0c8bf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA14077',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 229463,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-05',
'seller_name': None,
'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-29 18:47:31 [auto1.de] INFO: Saving data for KA14077: {'auction_closing_time': 1774883823.0, 'created_time': 1773382920.640793, 'last_price_update_time': 1774810051.659922}
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA14077') HTTP/1.1" 204 0
2026-03-29 18:47:31 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-29 18:47:31 [auto1.de] INFO: Scrape type for WD47381: 2
2026-03-29 18:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381
2026-03-29 18:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with scrape type 2
2026-03-29 18:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with scrape type 2
2026-03-29 18:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26, identifier: WD47381
2026-03-29 18:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381
2026-03-29 18:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381
2026-03-29 18:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3641fb43-a22f-5b5d-9c7b-81b4360dfb26 with identifier: WD47381 to the API
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:08:09Z',
'fuel_type': 'diesel',
'id': '3641fb43-a22f-5b5d-9c7b-81b4360dfb26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD47381',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 120621,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-18',
'seller_name': None,
'title': 'BMW 5er 530d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-29 18:47:32 [auto1.de] INFO: Saving data for WD47381: {'auction_closing_time': 1774883289.0, 'created_time': 1773345512.070836, 'last_price_update_time': 1774810052.100466}
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD47381') HTTP/1.1" 204 0
2026-03-29 18:47:32 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-29 18:47:32 [auto1.de] INFO: Scrape type for PT15230: 0
2026-03-29 18:47:32 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL18387%27 HTTP/1.1" 200 None
2026-03-29 18:47:32 [auto1.de] INFO: Scrape type for CL18387: 2
2026-03-29 18:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387
2026-03-29 18:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd050084-8988-5b17-b14b-1a5549565377 with scrape type 2
2026-03-29 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd050084-8988-5b17-b14b-1a5549565377 with scrape type 2
2026-03-29 18:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd050084-8988-5b17-b14b-1a5549565377, identifier: CL18387
2026-03-29 18:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387
2026-03-29 18:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387
2026-03-29 18:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd050084-8988-5b17-b14b-1a5549565377 with identifier: CL18387 to the API
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:23:18Z',
'fuel_type': 'petrol',
'id': 'cd050084-8988-5b17-b14b-1a5549565377',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL18387',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 191885,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-27',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2011}
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL18387%27 HTTP/1.1" 200 None
2026-03-29 18:47:32 [auto1.de] INFO: Saving data for CL18387: {'auction_closing_time': 1774884198.0, 'created_time': 1774723353.504606, 'last_price_update_time': 1774810052.537026}
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL18387') HTTP/1.1" 204 0
2026-03-29 18:47:32 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-29 18:47:32 [auto1.de] INFO: Scrape type for XP03484: 2
2026-03-29 18:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484
2026-03-29 18:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e256e908-a9d6-5147-b47d-1c18d2428160 with scrape type 2
2026-03-29 18:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e256e908-a9d6-5147-b47d-1c18d2428160 with scrape type 2
2026-03-29 18:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e256e908-a9d6-5147-b47d-1c18d2428160, identifier: XP03484
2026-03-29 18:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484
2026-03-29 18:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484
2026-03-29 18:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484 to the API
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:50:26Z',
'fuel_type': 'diesel',
'id': 'e256e908-a9d6-5147-b47d-1c18d2428160',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP03484',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 187061,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-05',
'seller_name': None,
'title': 'Ford Focus 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-29 18:47:33 [auto1.de] INFO: Saving data for XP03484: {'auction_closing_time': 1774885826.0, 'created_time': 1773946075.825579, 'last_price_update_time': 1774810053.109162}
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP03484') HTTP/1.1" 204 0
2026-03-29 18:47:33 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-29 18:47:33 [auto1.de] INFO: Scrape type for PN41265: 0
2026-03-29 18:47:33 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-29 18:47:33 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-29 18:47:33 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-29 18:47:33 [auto1.de] INFO: Scrape type for EP39271: 2
2026-03-29 18:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-29 18:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25a1eae-a566-552b-9c2b-1e095580e88b with scrape type 2
2026-03-29 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f25a1eae-a566-552b-9c2b-1e095580e88b with scrape type 2
2026-03-29 18:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f25a1eae-a566-552b-9c2b-1e095580e88b, identifier: EP39271
2026-03-29 18:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-29 18:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-29 18:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271 to the API
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 260,
'expiration_date': '2026-03-30T15:36:19Z',
'fuel_type': 'petrol',
'id': 'f25a1eae-a566-552b-9c2b-1e095580e88b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP39271',
'listing': 'auction',
'make': 'Dodge',
'model': 'Nitro',
'odometer': 60711,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-30',
'seller_name': None,
'title': 'Dodge Nitro 4.0 V6 R/T',
'transmission': 'automatic',
'trim': 'R/T',
'year': 2017}
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-29 18:47:33 [auto1.de] INFO: Saving data for EP39271: {'auction_closing_time': 1774884979.0, 'created_time': 1774263221.629681, 'last_price_update_time': 1774810053.593378}
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP39271') HTTP/1.1" 204 0
2026-03-29 18:47:33 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-29 18:47:33 [auto1.de] INFO: Scrape type for KE73798: 2
2026-03-29 18:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-29 18:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71af4e97-4731-5ae3-ad4c-183eef459ec3 with scrape type 2
2026-03-29 18:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71af4e97-4731-5ae3-ad4c-183eef459ec3 with scrape type 2
2026-03-29 18:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71af4e97-4731-5ae3-ad4c-183eef459ec3, identifier: KE73798
2026-03-29 18:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-29 18:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-29 18:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798 to the API
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:31:17Z',
'fuel_type': 'petrol',
'id': '71af4e97-4731-5ae3-ad4c-183eef459ec3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE73798',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 120659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-20',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2015}
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-29 18:47:34 [auto1.de] INFO: Saving data for KE73798: {'auction_closing_time': 1774884677.0, 'created_time': 1773306577.065688, 'last_price_update_time': 1774810054.048451}
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE73798') HTTP/1.1" 204 0
2026-03-29 18:47:34 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-29 18:47:34 [auto1.de] INFO: Scrape type for RH12349: 2
2026-03-29 18:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-29 18:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with scrape type 2
2026-03-29 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with scrape type 2
2026-03-29 18:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0, identifier: RH12349
2026-03-29 18:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-29 18:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-29 18:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349 to the API
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:44Z',
'fuel_type': 'petrol',
'id': 'adeca68a-a85c-5d02-bffd-c3f1ac7d1db0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH12349',
'listing': 'auction',
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 116615,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-02-12',
'seller_name': None,
'title': 'Toyota RAV 4 2.0 Special 4x4',
'transmission': 'manual',
'trim': 'Special 4x4',
'year': 2001}
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-29 18:47:34 [auto1.de] INFO: Saving data for RH12349: {'auction_closing_time': 1774883804.0, 'created_time': 1773343815.463306, 'last_price_update_time': 1774810054.52652}
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH12349') HTTP/1.1" 204 0
2026-03-29 18:47:34 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-29 18:47:34 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-29 18:47:34 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-29 18:47:34 [auto1.de] INFO: Scrape type for SX40224: 2
2026-03-29 18:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-29 18:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd814f5c-6156-58a7-86fd-c1e606c64ac9 with scrape type 2
2026-03-29 18:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd814f5c-6156-58a7-86fd-c1e606c64ac9 with scrape type 2
2026-03-29 18:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd814f5c-6156-58a7-86fd-c1e606c64ac9, identifier: SX40224
2026-03-29 18:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-29 18:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-29 18:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224 to the API
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:05Z',
'fuel_type': 'petrol',
'id': 'fd814f5c-6156-58a7-86fd-c1e606c64ac9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX40224',
'listing': 'auction',
'make': 'Opel',
'model': 'Crossland X',
'odometer': 47453,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-24',
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2017}
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-29 18:47:34 [auto1.de] INFO: Saving data for SX40224: {'auction_closing_time': 1774886345.0, 'created_time': 1773303355.25174, 'last_price_update_time': 1774810054.967742}
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX40224') HTTP/1.1" 204 0
2026-03-29 18:47:34 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-29 18:47:35 [auto1.de] INFO: Scrape type for SK86846: 2
2026-03-29 18:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-29 18:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b255f93a-f3a6-5684-9880-b9238c99a1d2 with scrape type 2
2026-03-29 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b255f93a-f3a6-5684-9880-b9238c99a1d2 with scrape type 2
2026-03-29 18:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b255f93a-f3a6-5684-9880-b9238c99a1d2, identifier: SK86846
2026-03-29 18:47:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-29 18:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-29 18:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846 to the API
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 355,
'expiration_date': '2026-03-30T15:03:35Z',
'fuel_type': 'petrol',
'id': 'b255f93a-f3a6-5684-9880-b9238c99a1d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK86846',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 161946,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-01',
'seller_name': None,
'title': 'BMW X5 4.8i',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-29 18:47:35 [auto1.de] INFO: Saving data for SK86846: {'auction_closing_time': 1774883015.0, 'created_time': 1773830968.221129, 'last_price_update_time': 1774810055.423889}
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK86846') HTTP/1.1" 204 0
2026-03-29 18:47:35 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-29 18:47:35 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-29 18:47:35 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-29 18:47:35 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-29 18:47:35 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-29 18:47:35 [auto1.de] INFO: Scrape type for VN58705: 0
2026-03-29 18:47:35 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-29 18:47:35 [auto1.de] INFO: Scrape type for XB16241: 2
2026-03-29 18:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-29 18:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with scrape type 2
2026-03-29 18:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with scrape type 2
2026-03-29 18:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0572a376-77bf-51a3-93ef-8de2f8eb6a82, identifier: XB16241
2026-03-29 18:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-29 18:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-29 18:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241 to the API
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:14:48Z',
'fuel_type': 'diesel',
'id': '0572a376-77bf-51a3-93ef-8de2f8eb6a82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB16241',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 145715,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-25',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI Active Start/Stop',
'transmission': 'manual',
'trim': 'Active Start/Stop',
'year': 2017}
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-29 18:47:36 [auto1.de] INFO: Saving data for XB16241: {'auction_closing_time': 1774883688.0, 'created_time': 1773775601.776793, 'last_price_update_time': 1774810056.056995}
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB16241') HTTP/1.1" 204 0
2026-03-29 18:47:36 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-29 18:47:36 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-29 18:47:36 [auto1.de] INFO: Scrape type for DC45431: 0
2026-03-29 18:47:36 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-29 18:47:36 [auto1.de] INFO: Scrape type for JY30583: 0
2026-03-29 18:47:36 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-29 18:47:36 [auto1.de] INFO: Scrape type for PU37095: 2
2026-03-29 18:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-29 18:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90434af9-4655-5121-a7a0-1bd4e25b93e5 with scrape type 2
2026-03-29 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90434af9-4655-5121-a7a0-1bd4e25b93e5 with scrape type 2
2026-03-29 18:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90434af9-4655-5121-a7a0-1bd4e25b93e5, identifier: PU37095
2026-03-29 18:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-29 18:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-29 18:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095 to the API
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:57:15Z',
'fuel_type': 'petrol',
'id': '90434af9-4655-5121-a7a0-1bd4e25b93e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU37095',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 61329,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-27',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2015}
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-29 18:47:36 [auto1.de] INFO: Saving data for PU37095: {'auction_closing_time': 1774886235.0, 'created_time': 1774607870.876091, 'last_price_update_time': 1774810056.526787}
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU37095') HTTP/1.1" 204 0
2026-03-29 18:47:36 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:36 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-29 18:47:36 [auto1.de] INFO: Scrape type for DA75557: 2
2026-03-29 18:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-29 18:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8dabb7f-ded5-5444-a559-3f45af3439c4 with scrape type 2
2026-03-29 18:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8dabb7f-ded5-5444-a559-3f45af3439c4 with scrape type 2
2026-03-29 18:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8dabb7f-ded5-5444-a559-3f45af3439c4, identifier: DA75557
2026-03-29 18:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-29 18:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-29 18:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557 to the API
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:04Z',
'fuel_type': 'petrol',
'id': 'a8dabb7f-ded5-5444-a559-3f45af3439c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA75557',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 234444,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-09',
'seller_name': None,
'title': 'Skoda Superb 1.5 TSI ACT Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2019}
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-29 18:47:36 [auto1.de] INFO: Saving data for DA75557: {'auction_closing_time': 1774883464.0, 'created_time': 1773860993.879053, 'last_price_update_time': 1774810056.960125}
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA75557') HTTP/1.1" 204 0
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Scrape type for MC25913: 0
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Scrape type for WJ52581: 0
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Scrape type for GJ53227: 0
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Scrape type for DB69488: 0
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Scrape type for MH48828: 0
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Scrape type for XS07294: 2
2026-03-29 18:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-29 18:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with scrape type 2
2026-03-29 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with scrape type 2
2026-03-29 18:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3, identifier: XS07294
2026-03-29 18:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:37 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Scrape type for FS06029: 2
2026-03-29 18:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-29 18:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db44d376-ccb5-5dfc-97a7-3802a6813b36 with scrape type 2
2026-03-29 18:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db44d376-ccb5-5dfc-97a7-3802a6813b36 with scrape type 2
2026-03-29 18:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db44d376-ccb5-5dfc-97a7-3802a6813b36, identifier: FS06029
2026-03-29 18:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-29 18:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-29 18:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294 to the API
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:40:45Z',
'fuel_type': 'diesel',
'id': '20031c62-cb95-5d60-b6e9-f9b29a1ccfa3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS07294',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 221992,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-30',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'manual',
'trim': 'Ultra',
'year': 2017}
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-29 18:47:37 [auto1.de] INFO: Saving data for XS07294: {'auction_closing_time': 1774885245.0, 'created_time': 1773773081.119513, 'last_price_update_time': 1774810057.698078}
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS07294') HTTP/1.1" 204 0
2026-03-29 18:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-29 18:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-29 18:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029 to the API
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:46:53Z',
'fuel_type': 'petrol',
'id': 'db44d376-ccb5-5dfc-97a7-3802a6813b36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS06029',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 139364,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-15',
'seller_name': None,
'title': 'Seat Ibiza 1.2 Style Viva',
'transmission': 'manual',
'trim': 'Style Viva',
'year': 2012}
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-29 18:47:38 [auto1.de] INFO: Saving data for FS06029: {'auction_closing_time': 1774885613.0, 'created_time': 1774330536.165143, 'last_price_update_time': 1774810058.045851}
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS06029') HTTP/1.1" 204 0
2026-03-29 18:47:38 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-29 18:47:38 [auto1.de] INFO: Scrape type for MU28825: 0
2026-03-29 18:47:38 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-29 18:47:38 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-29 18:47:38 [auto1.de] INFO: Scrape type for HR12459: 0
2026-03-29 18:47:38 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-29 18:47:38 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-29 18:47:38 [auto1.de] INFO: Scrape type for PH00058: 2
2026-03-29 18:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-29 18:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46500ce-d342-50d1-bab5-1adf103992a9 with scrape type 2
2026-03-29 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a46500ce-d342-50d1-bab5-1adf103992a9 with scrape type 2
2026-03-29 18:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a46500ce-d342-50d1-bab5-1adf103992a9, identifier: PH00058
2026-03-29 18:47:38 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-29 18:47:38 [auto1.de] INFO: Scrape type for CT18435: 2
2026-03-29 18:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-29 18:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23ef057-5cd6-5e2b-a70d-a3542464994f with scrape type 2
2026-03-29 18:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e23ef057-5cd6-5e2b-a70d-a3542464994f with scrape type 2
2026-03-29 18:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e23ef057-5cd6-5e2b-a70d-a3542464994f, identifier: CT18435
2026-03-29 18:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-29 18:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-29 18:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058 to the API
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:38:39Z',
'fuel_type': 'petrol',
'id': 'a46500ce-d342-50d1-bab5-1adf103992a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH00058',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 134647,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-25',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
'transmission': 'manual',
'trim': 'Quadrifoglio Verde',
'year': 2015}
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-29 18:47:38 [auto1.de] INFO: Saving data for PH00058: {'auction_closing_time': 1774885119.0, 'created_time': 1773305456.289794, 'last_price_update_time': 1774810058.636708}
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH00058') HTTP/1.1" 204 0
2026-03-29 18:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-29 18:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-29 18:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435 to the API
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:10:11Z',
'fuel_type': 'diesel',
'id': 'e23ef057-5cd6-5e2b-a70d-a3542464994f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT18435',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 200838,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-27',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Saving data for CT18435: {'auction_closing_time': 1774883411.0, 'created_time': 1773387332.721525, 'last_price_update_time': 1774810059.057318}
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT18435') HTTP/1.1" 204 0
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Scrape type for KU48054: 2
2026-03-29 18:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-29 18:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0129e928-3c84-5feb-91dc-6bca30cbfa90 with scrape type 2
2026-03-29 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0129e928-3c84-5feb-91dc-6bca30cbfa90 with scrape type 2
2026-03-29 18:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0129e928-3c84-5feb-91dc-6bca30cbfa90, identifier: KU48054
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Scrape type for WL45042: 0
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Scrape type for TE62268: 0
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Scrape type for DV26733: 0
2026-03-29 18:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-29 18:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054
2026-03-29 18:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0129e928-3c84-5feb-91dc-6bca30cbfa90 with identifier: KU48054 to the API
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 178,
'expiration_date': '2026-03-30T15:33:08Z',
'fuel_type': 'petrol',
'id': '0129e928-3c84-5feb-91dc-6bca30cbfa90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU48054',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 6971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-03-24',
'seller_name': None,
'title': 'BMW 1er 120i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2024}
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Saving data for KU48054: {'auction_closing_time': 1774884788.0, 'created_time': 1774521582.177692, 'last_price_update_time': 1774810059.510164}
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU48054') HTTP/1.1" 204 0
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Scrape type for SF51688: 2
2026-03-29 18:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-29 18:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef081bb-b369-51fa-a235-9d3a33f23b83 with scrape type 2
2026-03-29 18:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cef081bb-b369-51fa-a235-9d3a33f23b83 with scrape type 2
2026-03-29 18:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cef081bb-b369-51fa-a235-9d3a33f23b83, identifier: SF51688
2026-03-29 18:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-29 18:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-29 18:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688 to the API
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:23:51Z',
'fuel_type': 'petrol',
'id': 'cef081bb-b369-51fa-a235-9d3a33f23b83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF51688',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 10925,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-11-28',
'seller_name': None,
'title': 'Audi A1 Sportback 30 TFSI Advanced',
'transmission': 'automatic',
'trim': 'Advanced',
'year': 2024}
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Saving data for SF51688: {'auction_closing_time': 1774884231.0, 'created_time': 1774608471.425328, 'last_price_update_time': 1774810059.949475}
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF51688') HTTP/1.1" 204 0
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-29 18:47:39 [auto1.de] INFO: Scrape type for VW78119: 0
2026-03-29 18:47:39 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-29 18:47:40 [auto1.de] INFO: Scrape type for WC14239: 2
2026-03-29 18:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-29 18:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with scrape type 2
2026-03-29 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with scrape type 2
2026-03-29 18:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21, identifier: WC14239
2026-03-29 18:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-29 18:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-29 18:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239 to the API
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:23:39Z',
'fuel_type': 'petrol',
'id': '1f728d3a-6c70-568d-9d02-6ed7b5d83f21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC14239',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 80783,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-04',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
'transmission': 'automatic',
'trim': 'GTI Performance BlueMotion',
'year': 2019}
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-29 18:47:40 [auto1.de] INFO: Saving data for WC14239: {'auction_closing_time': 1774884219.0, 'created_time': 1773402596.624837, 'last_price_update_time': 1774810060.431289}
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC14239') HTTP/1.1" 204 0
2026-03-29 18:47:40 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-29 18:47:40 [auto1.de] INFO: Scrape type for DG34410: 2
2026-03-29 18:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-29 18:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32396ce5-c841-5787-9313-5ee60592a2c4 with scrape type 2
2026-03-29 18:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32396ce5-c841-5787-9313-5ee60592a2c4 with scrape type 2
2026-03-29 18:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32396ce5-c841-5787-9313-5ee60592a2c4, identifier: DG34410
2026-03-29 18:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-29 18:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-29 18:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410 to the API
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:18:22Z',
'fuel_type': 'petrol',
'id': '32396ce5-c841-5787-9313-5ee60592a2c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG34410',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 105777,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-11',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
'transmission': 'automatic',
'trim': 'Highline 4Motion BlueMotion',
'year': 2016}
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-29 18:47:40 [auto1.de] INFO: Saving data for DG34410: {'auction_closing_time': 1774883902.0, 'created_time': 1774262886.678608, 'last_price_update_time': 1774810060.999379}
2026-03-29 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG34410') HTTP/1.1" 204 0
2026-03-29 18:47:41 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-29 18:47:41 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-29 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-29 18:47:41 [auto1.de] INFO: Scrape type for UP16968: 2
2026-03-29 18:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-29 18:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with scrape type 2
2026-03-29 18:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with scrape type 2
2026-03-29 18:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73, identifier: UP16968
2026-03-29 18:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-29 18:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968
2026-03-29 18:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d41dcc3-3c03-5e8c-b493-26f6384c2f73 with identifier: UP16968 to the API
2026-03-29 18:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:16:04Z',
'fuel_type': 'petrol',
'id': '5d41dcc3-3c03-5e8c-b493-26f6384c2f73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP16968',
'listing': 'auction',
'make': 'Skoda',
'model': 'Rapid Spaceback',
'odometer': 101052,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-10',
'seller_name': None,
'title': 'Skoda Rapid Spaceback 1.2 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2015}
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-29 18:47:42 [auto1.de] INFO: Saving data for UP16968: {'auction_closing_time': 1774883764.0, 'created_time': 1774522366.212166, 'last_price_update_time': 1774810062.388235}
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP16968') HTTP/1.1" 204 0
2026-03-29 18:47:42 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-29 18:47:42 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-29 18:47:42 [auto1.de] INFO: Scrape type for XH60803: 2
2026-03-29 18:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-29 18:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10d7e07-2d9b-5fc3-af76-43281d86d1cc with scrape type 2
2026-03-29 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10d7e07-2d9b-5fc3-af76-43281d86d1cc with scrape type 2
2026-03-29 18:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f10d7e07-2d9b-5fc3-af76-43281d86d1cc, identifier: XH60803
2026-03-29 18:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-29 18:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-29 18:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803 to the API
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:41Z',
'fuel_type': 'diesel',
'id': 'f10d7e07-2d9b-5fc3-af76-43281d86d1cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH60803',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 265844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-08',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion Tech',
'year': 2016}
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-29 18:47:42 [auto1.de] INFO: Saving data for XH60803: {'auction_closing_time': 1774886081.0, 'created_time': 1774034973.94635, 'last_price_update_time': 1774810062.836779}
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH60803') HTTP/1.1" 204 0
2026-03-29 18:47:42 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-29 18:47:42 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-29 18:47:42 [auto1.de] INFO: Scrape type for YH55403: 2
2026-03-29 18:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-29 18:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with scrape type 2
2026-03-29 18:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with scrape type 2
2026-03-29 18:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca, identifier: YH55403
2026-03-29 18:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-29 18:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403
2026-03-29 18:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca with identifier: YH55403 to the API
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:37:11Z',
'fuel_type': 'petrol',
'id': '5cabd4d5-e3d5-5252-a0a3-3518ab2f5dca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH55403',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 130298,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-13',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2011}
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-29 18:47:43 [auto1.de] INFO: Saving data for YH55403: {'auction_closing_time': 1774885031.0, 'created_time': 1774521782.404606, 'last_price_update_time': 1774810063.237297}
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH55403') HTTP/1.1" 204 0
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-29 18:47:43 [auto1.de] INFO: Scrape type for ED54075: 0
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-29 18:47:43 [auto1.de] INFO: Scrape type for XB63697: 2
2026-03-29 18:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697
2026-03-29 18:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3978a967-4222-5b19-b692-1597eeece47b with scrape type 2
2026-03-29 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3978a967-4222-5b19-b692-1597eeece47b with scrape type 2
2026-03-29 18:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3978a967-4222-5b19-b692-1597eeece47b, identifier: XB63697
2026-03-29 18:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697
2026-03-29 18:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697
2026-03-29 18:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3978a967-4222-5b19-b692-1597eeece47b with identifier: XB63697 to the API
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:18:40Z',
'fuel_type': 'petrol',
'id': '3978a967-4222-5b19-b692-1597eeece47b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB63697',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 101422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-12',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-29 18:47:43 [auto1.de] INFO: Saving data for XB63697: {'auction_closing_time': 1774883920.0, 'created_time': 1774636575.75196, 'last_price_update_time': 1774810063.645966}
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB63697') HTTP/1.1" 204 0
2026-03-29 18:47:43 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-29 18:47:43 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-29 18:47:43 [auto1.de] INFO: Scrape type for AA34634: 2
2026-03-29 18:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-29 18:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with scrape type 2
2026-03-29 18:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with scrape type 2
2026-03-29 18:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97, identifier: AA34634
2026-03-29 18:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-29 18:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-29 18:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634 to the API
2026-03-29 18:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:34:40Z',
'fuel_type': 'diesel',
'id': 'da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA34634',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 212830,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-20',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI FR',
'transmission': 'manual',
'trim': 'FR',
'year': 2015}
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-29 18:47:44 [auto1.de] INFO: Saving data for AA34634: {'auction_closing_time': 1774884880.0, 'created_time': 1773305407.164739, 'last_price_update_time': 1774810064.183552}
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA34634') HTTP/1.1" 204 0
2026-03-29 18:47:44 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-29 18:47:44 [auto1.de] INFO: Scrape type for TR13972: 0
2026-03-29 18:47:44 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-29 18:47:44 [auto1.de] INFO: Scrape type for TB72166: 0
2026-03-29 18:47:44 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-29 18:47:44 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-29 18:47:44 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-29 18:47:44 [auto1.de] INFO: Scrape type for GK82878: 2
2026-03-29 18:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-29 18:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with scrape type 2
2026-03-29 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with scrape type 2
2026-03-29 18:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f, identifier: GK82878
2026-03-29 18:47:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-29 18:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-29 18:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878 to the API
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:52:54Z',
'fuel_type': 'petrol',
'id': '04ed7688-e5aa-58a2-a68a-12a6a4cd819f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK82878',
'listing': 'auction',
'make': 'Mazda',
'model': '6',
'odometer': 122549,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-19',
'seller_name': None,
'title': 'Mazda 6 1.8 Active Sport',
'transmission': 'manual',
'trim': 'Active Sport',
'year': 2007}
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-29 18:47:44 [auto1.de] INFO: Saving data for GK82878: {'auction_closing_time': 1774885974.0, 'created_time': 1773345580.268085, 'last_price_update_time': 1774810064.677949}
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK82878') HTTP/1.1" 204 0
2026-03-29 18:47:44 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-29 18:47:44 [auto1.de] INFO: Scrape type for AH76263: 2
2026-03-29 18:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-29 18:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9926c6-1a01-552a-83db-73be151299c7 with scrape type 2
2026-03-29 18:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a9926c6-1a01-552a-83db-73be151299c7 with scrape type 2
2026-03-29 18:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a9926c6-1a01-552a-83db-73be151299c7, identifier: AH76263
2026-03-29 18:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-29 18:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-29 18:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263 to the API
2026-03-29 18:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:19Z',
'fuel_type': 'petrol',
'id': '1a9926c6-1a01-552a-83db-73be151299c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH76263',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 41610,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-22',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI ACT S line',
'transmission': 'manual',
'trim': 'ACT S line',
'year': 2022}
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-29 18:47:45 [auto1.de] INFO: Saving data for AH76263: {'auction_closing_time': 1774885159.0, 'created_time': 1774608571.800093, 'last_price_update_time': 1774810065.235282}
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH76263') HTTP/1.1" 204 0
2026-03-29 18:47:45 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-29 18:47:45 [auto1.de] INFO: Scrape type for RE17291: 2
2026-03-29 18:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-29 18:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d325fbd-37b0-5063-80f7-7e252e004c80 with scrape type 2
2026-03-29 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d325fbd-37b0-5063-80f7-7e252e004c80 with scrape type 2
2026-03-29 18:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d325fbd-37b0-5063-80f7-7e252e004c80, identifier: RE17291
2026-03-29 18:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-29 18:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-29 18:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291 to the API
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:33:16Z',
'fuel_type': 'petrol',
'id': '9d325fbd-37b0-5063-80f7-7e252e004c80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE17291',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 177698,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-27',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2014}
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-29 18:47:45 [auto1.de] INFO: Saving data for RE17291: {'auction_closing_time': 1774884796.0, 'created_time': 1773773948.019418, 'last_price_update_time': 1774810065.666274}
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE17291') HTTP/1.1" 204 0
2026-03-29 18:47:45 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-29 18:47:45 [auto1.de] INFO: Scrape type for FW17566: 0
2026-03-29 18:47:45 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-29 18:47:45 [auto1.de] INFO: Scrape type for KZ08446: 2
2026-03-29 18:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-29 18:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0062780f-5834-5996-80a8-4cd62721e991 with scrape type 2
2026-03-29 18:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0062780f-5834-5996-80a8-4cd62721e991 with scrape type 2
2026-03-29 18:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0062780f-5834-5996-80a8-4cd62721e991, identifier: KZ08446
2026-03-29 18:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-29 18:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-29 18:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446 to the API
2026-03-29 18:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:07:10Z',
'fuel_type': 'petrol',
'id': '0062780f-5834-5996-80a8-4cd62721e991',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ08446',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand C-Max',
'odometer': 85779,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-11',
'seller_name': None,
'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Saving data for KZ08446: {'auction_closing_time': 1774883230.0, 'created_time': 1774290938.902477, 'last_price_update_time': 1774810066.138807}
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ08446') HTTP/1.1" 204 0
2026-03-29 18:47:46 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Scrape type for JE63209: 0
2026-03-29 18:47:46 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Scrape type for XF69711: 0
2026-03-29 18:47:46 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Scrape type for LG14715: 0
2026-03-29 18:47:46 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-29 18:47:46 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Scrape type for BU80975: 2
2026-03-29 18:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975
2026-03-29 18:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with scrape type 2
2026-03-29 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with scrape type 2
2026-03-29 18:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62, identifier: BU80975
2026-03-29 18:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975
2026-03-29 18:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975
2026-03-29 18:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19dcf5ae-f17a-54f1-ae2f-6676fc631d62 with identifier: BU80975 to the API
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:35:14Z',
'fuel_type': 'petrol',
'id': '19dcf5ae-f17a-54f1-ae2f-6676fc631d62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU80975',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 218202,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-07',
'seller_name': None,
'title': 'Audi A4 1.8 TFSI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2009}
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Saving data for BU80975: {'auction_closing_time': 1774884914.0, 'created_time': 1774034561.238225, 'last_price_update_time': 1774810066.580582}
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU80975') HTTP/1.1" 204 0
2026-03-29 18:47:46 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Scrape type for BF92726: 2
2026-03-29 18:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-29 18:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9afe3d-340a-57f2-a386-501cee4d9c04 with scrape type 2
2026-03-29 18:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9afe3d-340a-57f2-a386-501cee4d9c04 with scrape type 2
2026-03-29 18:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9afe3d-340a-57f2-a386-501cee4d9c04, identifier: BF92726
2026-03-29 18:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-29 18:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726
2026-03-29 18:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9afe3d-340a-57f2-a386-501cee4d9c04 with identifier: BF92726 to the API
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:13:35Z',
'fuel_type': 'petrol',
'id': '9a9afe3d-340a-57f2-a386-501cee4d9c04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF92726',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 214051,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-22',
'seller_name': None,
'title': 'Skoda Octavia 1.4 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2009}
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-29 18:47:46 [auto1.de] INFO: Saving data for BF92726: {'auction_closing_time': 1774883615.0, 'created_time': 1774522180.070826, 'last_price_update_time': 1774810066.985232}
2026-03-29 18:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF92726') HTTP/1.1" 204 0
2026-03-29 18:47:47 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-29 18:47:47 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-29 18:47:47 [auto1.de] INFO: Scrape type for DP00162: 2
2026-03-29 18:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-29 18:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with scrape type 2
2026-03-29 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with scrape type 2
2026-03-29 18:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1, identifier: DP00162
2026-03-29 18:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-29 18:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162
2026-03-29 18:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8245bdf6-662b-5846-b1e5-6f9dacfbf7d1 with identifier: DP00162 to the API
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:08:41Z',
'fuel_type': 'diesel',
'id': '8245bdf6-662b-5846-b1e5-6f9dacfbf7d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP00162',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 237483,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-05',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2017}
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-29 18:47:47 [auto1.de] INFO: Saving data for DP00162: {'auction_closing_time': 1774883321.0, 'created_time': 1773427075.494201, 'last_price_update_time': 1774810067.394461}
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP00162') HTTP/1.1" 204 0
2026-03-29 18:47:47 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-29 18:47:47 [auto1.de] INFO: Scrape type for BB37977: 2
2026-03-29 18:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-29 18:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0218e752-1b3e-526c-beff-52955fd0c744 with scrape type 2
2026-03-29 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0218e752-1b3e-526c-beff-52955fd0c744 with scrape type 2
2026-03-29 18:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0218e752-1b3e-526c-beff-52955fd0c744, identifier: BB37977
2026-03-29 18:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-29 18:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977
2026-03-29 18:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0218e752-1b3e-526c-beff-52955fd0c744 with identifier: BB37977 to the API
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 255,
'expiration_date': '2026-03-30T15:43:43Z',
'fuel_type': 'diesel',
'id': '0218e752-1b3e-526c-beff-52955fd0c744',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB37977',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery 4',
'odometer': 158338,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-17',
'seller_name': None,
'title': 'Land Rover Discovery 4 3.0 TD V6 SDV6 HSE',
'transmission': 'automatic',
'trim': 'SDV6 HSE',
'year': 2013}
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-29 18:47:47 [auto1.de] INFO: Saving data for BB37977: {'auction_closing_time': 1774885423.0, 'created_time': 1774521365.47602, 'last_price_update_time': 1774810067.874124}
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB37977') HTTP/1.1" 204 0
2026-03-29 18:47:47 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-29 18:47:47 [auto1.de] INFO: Scrape type for XR27730: 0
2026-03-29 18:47:47 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-29 18:47:47 [auto1.de] INFO: Scrape type for MK34658: 0
2026-03-29 18:47:47 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-29 18:47:47 [auto1.de] INFO: Scrape type for YV93929: 2
2026-03-29 18:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-29 18:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with scrape type 2
2026-03-29 18:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with scrape type 2
2026-03-29 18:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf83a435-efcc-5fd5-931b-6b7d552a6ed3, identifier: YV93929
2026-03-29 18:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-29 18:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-29 18:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929 to the API
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:25:32Z',
'fuel_type': 'petrol',
'id': 'cf83a435-efcc-5fd5-931b-6b7d552a6ed3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV93929',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 106494,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-10',
'seller_name': None,
'title': 'Ford Focus 2.3 EcoBoost ST',
'transmission': 'manual',
'trim': 'ST',
'year': 2019}
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Saving data for YV93929: {'auction_closing_time': 1774884332.0, 'created_time': 1773772703.753748, 'last_price_update_time': 1774810068.366717}
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV93929') HTTP/1.1" 204 0
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Scrape type for YZ02891: 0
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Scrape type for KY14800: 2
2026-03-29 18:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-29 18:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with scrape type 2
2026-03-29 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with scrape type 2
2026-03-29 18:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a, identifier: KY14800
2026-03-29 18:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-29 18:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-29 18:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800 to the API
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:24:57Z',
'fuel_type': 'petrol',
'id': '21b862dc-a0e5-522d-8fdb-fc7118f6ad2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY14800',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 124071,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-03',
'seller_name': None,
'title': 'Audi A6 55 TFSI Mild-Hybrid quattro sport',
'transmission': 'automatic',
'trim': 'quattro sport',
'year': 2020}
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Saving data for KY14800: {'auction_closing_time': 1774884297.0, 'created_time': 1773383156.081231, 'last_price_update_time': 1774810068.820494}
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY14800') HTTP/1.1" 204 0
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Scrape type for LV90463: 0
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Scrape type for XL60244: 0
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Scrape type for SX16558: 0
2026-03-29 18:47:48 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-29 18:47:48 [auto1.de] INFO: Scrape type for FZ45055: 2
2026-03-29 18:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-29 18:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with scrape type 2
2026-03-29 18:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with scrape type 2
2026-03-29 18:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fef3f42b-d660-505b-abd0-a09fd8ac0fd0, identifier: FZ45055
2026-03-29 18:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-29 18:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-29 18:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055 to the API
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:07:14Z',
'fuel_type': 'diesel',
'id': 'fef3f42b-d660-505b-abd0-a09fd8ac0fd0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ45055',
'listing': 'auction',
'make': 'Skoda',
'model': 'Scala',
'odometer': 132822,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-31',
'seller_name': None,
'title': 'Skoda Scala 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2020}
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-29 18:47:49 [auto1.de] INFO: Saving data for FZ45055: {'auction_closing_time': 1774883234.0, 'created_time': 1773992658.24959, 'last_price_update_time': 1774810069.395394}
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ45055') HTTP/1.1" 204 0
2026-03-29 18:47:49 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-29 18:47:49 [auto1.de] INFO: Scrape type for TE33138: 2
2026-03-29 18:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-29 18:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013dee42-5b46-5376-9494-28a7b737d5d1 with scrape type 2
2026-03-29 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013dee42-5b46-5376-9494-28a7b737d5d1 with scrape type 2
2026-03-29 18:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 013dee42-5b46-5376-9494-28a7b737d5d1, identifier: TE33138
2026-03-29 18:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-29 18:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-29 18:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138 to the API
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:30:18Z',
'fuel_type': 'petrol',
'id': '013dee42-5b46-5376-9494-28a7b737d5d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE33138',
'listing': 'auction',
'make': 'Peugeot',
'model': 'RCZ',
'odometer': 116417,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-28',
'seller_name': None,
'title': 'Peugeot RCZ 1.6 THP Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-29 18:47:49 [auto1.de] INFO: Saving data for TE33138: {'auction_closing_time': 1774884618.0, 'created_time': 1774264872.736288, 'last_price_update_time': 1774810069.826548}
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE33138') HTTP/1.1" 204 0
2026-03-29 18:47:49 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-29 18:47:49 [auto1.de] INFO: Scrape type for XB85812: 0
2026-03-29 18:47:49 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-29 18:47:49 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-29 18:47:49 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-29 18:47:49 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:49 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-29 18:47:49 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-29 18:47:49 [auto1.de] INFO: Scrape type for JL71783: 2
2026-03-29 18:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-29 18:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with scrape type 2
2026-03-29 18:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with scrape type 2
2026-03-29 18:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f, identifier: JL71783
2026-03-29 18:47:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-29 18:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-29 18:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783 to the API
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:35:32Z',
'fuel_type': 'petrol',
'id': '11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL71783',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 141940,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-15',
'seller_name': None,
'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2012}
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-29 18:47:50 [auto1.de] INFO: Saving data for JL71783: {'auction_closing_time': 1774884932.0, 'created_time': 1773400722.145193, 'last_price_update_time': 1774810070.293312}
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL71783') HTTP/1.1" 204 0
2026-03-29 18:47:50 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-29 18:47:50 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-29 18:47:50 [auto1.de] INFO: Scrape type for AZ50044: 2
2026-03-29 18:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-29 18:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498896fd-63c0-565b-86e8-6e75805e561b with scrape type 2
2026-03-29 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 498896fd-63c0-565b-86e8-6e75805e561b with scrape type 2
2026-03-29 18:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 498896fd-63c0-565b-86e8-6e75805e561b, identifier: AZ50044
2026-03-29 18:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-29 18:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-29 18:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044 to the API
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:23:45Z',
'fuel_type': 'diesel',
'id': '498896fd-63c0-565b-86e8-6e75805e561b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ50044',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 335881,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-02',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2010}
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-29 18:47:50 [auto1.de] INFO: Saving data for AZ50044: {'auction_closing_time': 1774884225.0, 'created_time': 1774291892.600597, 'last_price_update_time': 1774810070.821308}
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ50044') HTTP/1.1" 204 0
2026-03-29 18:47:50 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-29 18:47:50 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-29 18:47:50 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-29 18:47:50 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-29 18:47:50 [auto1.de] INFO: Scrape type for WZ21973: 2
2026-03-29 18:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-29 18:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8190a8f7-7760-5055-b346-917965981869 with scrape type 2
2026-03-29 18:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8190a8f7-7760-5055-b346-917965981869 with scrape type 2
2026-03-29 18:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8190a8f7-7760-5055-b346-917965981869, identifier: WZ21973
2026-03-29 18:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-29 18:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-29 18:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973 to the API
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 50,
'expiration_date': '2026-03-30T15:25:33Z',
'fuel_type': 'petrol',
'id': '8190a8f7-7760-5055-b346-917965981869',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ21973',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Lupo',
'odometer': 80907,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-02-28',
'seller_name': None,
'title': 'Volkswagen Lupo 1.0 Rave',
'transmission': 'manual',
'trim': 'Rave',
'year': 2005}
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-29 18:47:51 [auto1.de] INFO: Saving data for WZ21973: {'auction_closing_time': 1774884333.0, 'created_time': 1774118809.300286, 'last_price_update_time': 1774810071.258261}
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ21973') HTTP/1.1" 204 0
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-29 18:47:51 [auto1.de] INFO: Scrape type for CF91602: 0
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-29 18:47:51 [auto1.de] INFO: Scrape type for CS24568: 2
2026-03-29 18:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-29 18:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03179b01-338a-57da-85c5-d3dbbdb45cd8 with scrape type 2
2026-03-29 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03179b01-338a-57da-85c5-d3dbbdb45cd8 with scrape type 2
2026-03-29 18:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03179b01-338a-57da-85c5-d3dbbdb45cd8, identifier: CS24568
2026-03-29 18:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-29 18:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-29 18:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568 to the API
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:42:20Z',
'fuel_type': 'petrol',
'id': '03179b01-338a-57da-85c5-d3dbbdb45cd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS24568',
'listing': 'auction',
'make': 'Cupra',
'model': 'Leon',
'odometer': 68574,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-24',
'seller_name': None,
'title': 'Cupra Leon 2.0 TSI',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-29 18:47:51 [auto1.de] INFO: Saving data for CS24568: {'auction_closing_time': 1774885340.0, 'created_time': 1774035480.243479, 'last_price_update_time': 1774810071.721129}
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS24568') HTTP/1.1" 204 0
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-29 18:47:51 [auto1.de] INFO: Scrape type for NW97614: 0
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-29 18:47:51 [auto1.de] INFO: Scrape type for YT11339: 0
2026-03-29 18:47:51 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-29 18:47:51 [auto1.de] INFO: Scrape type for YY92615: 2
2026-03-29 18:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-29 18:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7928b9de-98fa-5b16-83e0-e30944e8187b with scrape type 2
2026-03-29 18:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7928b9de-98fa-5b16-83e0-e30944e8187b with scrape type 2
2026-03-29 18:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7928b9de-98fa-5b16-83e0-e30944e8187b, identifier: YY92615
2026-03-29 18:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-29 18:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-29 18:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615 to the API
2026-03-29 18:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:20:40Z',
'fuel_type': 'diesel',
'id': '7928b9de-98fa-5b16-83e0-e30944e8187b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY92615',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 144906,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-31',
'seller_name': None,
'title': 'Volkswagen T-Roc 2.0 TDI Sport 4Motion',
'transmission': 'automatic',
'trim': 'Sport 4Motion',
'year': 2020}
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-29 18:47:52 [auto1.de] INFO: Saving data for YY92615: {'auction_closing_time': 1774884040.0, 'created_time': 1774294217.995412, 'last_price_update_time': 1774810072.19643}
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY92615') HTTP/1.1" 204 0
2026-03-29 18:47:52 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-29 18:47:52 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-29 18:47:52 [auto1.de] INFO: Scrape type for ML67017: 2
2026-03-29 18:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017
2026-03-29 18:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with scrape type 2
2026-03-29 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with scrape type 2
2026-03-29 18:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f, identifier: ML67017
2026-03-29 18:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017
2026-03-29 18:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017
2026-03-29 18:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ab8f4ae-3484-5224-a9d5-167aa23ceb6f with identifier: ML67017 to the API
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:40:25Z',
'fuel_type': 'hybrid',
'id': '9ab8f4ae-3484-5224-a9d5-167aa23ceb6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML67017',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 26223,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-28',
'seller_name': None,
'title': 'Kia Sorento 1.6 TGDI Plug-in Hybrid Spirit 4WD',
'transmission': 'automatic',
'trim': 'Spirit 4WD',
'year': 2022}
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-29 18:47:52 [auto1.de] INFO: Saving data for ML67017: {'auction_closing_time': 1774885225.0, 'created_time': 1773344749.390344, 'last_price_update_time': 1774810072.689686}
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML67017') HTTP/1.1" 204 0
2026-03-29 18:47:52 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-29 18:47:52 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-29 18:47:52 [auto1.de] INFO: Scrape type for SS86318: 2
2026-03-29 18:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-29 18:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584eede6-04c5-5c0b-a222-3a476e832d8e with scrape type 2
2026-03-29 18:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584eede6-04c5-5c0b-a222-3a476e832d8e with scrape type 2
2026-03-29 18:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 584eede6-04c5-5c0b-a222-3a476e832d8e, identifier: SS86318
2026-03-29 18:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-29 18:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318
2026-03-29 18:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 584eede6-04c5-5c0b-a222-3a476e832d8e with identifier: SS86318 to the API
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:56:37Z',
'fuel_type': 'diesel',
'id': '584eede6-04c5-5c0b-a222-3a476e832d8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS86318',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 307127,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-20',
'seller_name': None,
'title': 'Volkswagen Caddy 1.9 TDI Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2007}
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-29 18:47:53 [auto1.de] INFO: Saving data for SS86318: {'auction_closing_time': 1774886197.0, 'created_time': 1773429695.937796, 'last_price_update_time': 1774810073.107701}
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS86318') HTTP/1.1" 204 0
2026-03-29 18:47:53 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-29 18:47:53 [auto1.de] INFO: Scrape type for LS92843: 2
2026-03-29 18:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-29 18:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f772a1-8beb-5539-9ca4-503036589778 with scrape type 2
2026-03-29 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23f772a1-8beb-5539-9ca4-503036589778 with scrape type 2
2026-03-29 18:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23f772a1-8beb-5539-9ca4-503036589778, identifier: LS92843
2026-03-29 18:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-29 18:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-29 18:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843 to the API
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:43:00Z',
'fuel_type': 'petrol',
'id': '23f772a1-8beb-5539-9ca4-503036589778',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS92843',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 154983,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-18',
'seller_name': None,
'title': 'Ford Mondeo 2.5 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2007}
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-29 18:47:53 [auto1.de] INFO: Saving data for LS92843: {'auction_closing_time': 1774885380.0, 'created_time': 1774292162.249993, 'last_price_update_time': 1774810073.929804}
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS92843') HTTP/1.1" 204 0
2026-03-29 18:47:53 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-29 18:47:53 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-29 18:47:53 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-29 18:47:53 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-29 18:47:53 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-29 18:47:53 [auto1.de] INFO: Scrape type for PB28144: 2
2026-03-29 18:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-29 18:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with scrape type 2
2026-03-29 18:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with scrape type 2
2026-03-29 18:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7628a106-4bdd-5030-a8f2-12f1a7c24f90, identifier: PB28144
2026-03-29 18:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-29 18:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-29 18:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144 to the API
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:36:45Z',
'fuel_type': 'petrol',
'id': '7628a106-4bdd-5030-a8f2-12f1a7c24f90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB28144',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 147726,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-27',
'seller_name': None,
'title': 'Mitsubishi ASX 1.6 Edition 2WD',
'transmission': 'manual',
'trim': 'Edition 2WD',
'year': 2014}
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-29 18:47:54 [auto1.de] INFO: Saving data for PB28144: {'auction_closing_time': 1774885005.0, 'created_time': 1773555375.668089, 'last_price_update_time': 1774810074.386518}
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB28144') HTTP/1.1" 204 0
2026-03-29 18:47:54 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-29 18:47:54 [auto1.de] INFO: Scrape type for AD21201: 0
2026-03-29 18:47:54 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-29 18:47:54 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-29 18:47:54 [auto1.de] INFO: Scrape type for RG95107: 2
2026-03-29 18:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-29 18:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a92588-96dc-568d-8b35-e12fb26e50a0 with scrape type 2
2026-03-29 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56a92588-96dc-568d-8b35-e12fb26e50a0 with scrape type 2
2026-03-29 18:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56a92588-96dc-568d-8b35-e12fb26e50a0, identifier: RG95107
2026-03-29 18:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-29 18:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107
2026-03-29 18:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56a92588-96dc-568d-8b35-e12fb26e50a0 with identifier: RG95107 to the API
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:18:14Z',
'fuel_type': 'petrol',
'id': '56a92588-96dc-568d-8b35-e12fb26e50a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG95107',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 62529,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-16',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-29 18:47:54 [auto1.de] INFO: Saving data for RG95107: {'auction_closing_time': 1774883894.0, 'created_time': 1773382713.457011, 'last_price_update_time': 1774810074.799812}
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG95107') HTTP/1.1" 204 0
2026-03-29 18:47:54 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6740 | hits on page: 40
2026-03-29 18:47:54 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-29 18:47:54 [auto1.de] INFO: Scrape type for SV60739: 2
2026-03-29 18:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-29 18:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with scrape type 2
2026-03-29 18:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with scrape type 2
2026-03-29 18:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bec28c5-1c2b-5132-b3c4-e1281ca87221, identifier: SV60739
2026-03-29 18:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-29 18:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-29 18:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739 to the API
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:52:35Z',
'fuel_type': 'diesel',
'id': '4bec28c5-1c2b-5132-b3c4-e1281ca87221',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV60739',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60',
'odometer': 224340,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-05',
'seller_name': None,
'title': 'Volvo V60 1.6 D Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2012}
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Saving data for SV60739: {'auction_closing_time': 1774885955.0, 'created_time': 1774608203.342127, 'last_price_update_time': 1774810075.319446}
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV60739') HTTP/1.1" 204 0
2026-03-29 18:47:55 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Scrape type for EL23730: 0
2026-03-29 18:47:55 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Scrape type for TX33214: 0
2026-03-29 18:47:55 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Scrape type for CJ94447: 0
2026-03-29 18:47:55 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Scrape type for KW65379: 0
2026-03-29 18:47:55 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Scrape type for UV35373: 2
2026-03-29 18:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-29 18:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with scrape type 2
2026-03-29 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with scrape type 2
2026-03-29 18:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f, identifier: UV35373
2026-03-29 18:47:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:47:55 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Scrape type for FH60355: 0
2026-03-29 18:47:55 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Scrape type for UB59521: 2
2026-03-29 18:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521
2026-03-29 18:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9a9748a-a39b-5c34-83e5-c224e72ea67c with scrape type 2
2026-03-29 18:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9a9748a-a39b-5c34-83e5-c224e72ea67c with scrape type 2
2026-03-29 18:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9a9748a-a39b-5c34-83e5-c224e72ea67c, identifier: UB59521
2026-03-29 18:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-29 18:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-29 18:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373 to the API
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:31:29Z',
'fuel_type': 'diesel',
'id': '9333e0f4-d27c-508e-a85f-d3fab7aadb9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV35373',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 291851,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-12',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-29 18:47:55 [auto1.de] INFO: Saving data for UV35373: {'auction_closing_time': 1774884689.0, 'created_time': 1773689112.967782, 'last_price_update_time': 1774810075.953775}
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV35373') HTTP/1.1" 204 0
2026-03-29 18:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521
2026-03-29 18:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521
2026-03-29 18:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9a9748a-a39b-5c34-83e5-c224e72ea67c with identifier: UB59521 to the API
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:54:50Z',
'fuel_type': 'petrol',
'id': 'f9a9748a-a39b-5c34-83e5-c224e72ea67c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB59521',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 139287,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-16',
'seller_name': None,
'title': 'Audi A4 1.8 TFSI S line Sportpaket plus',
'transmission': 'manual',
'trim': 'S line Sportpaket plus',
'year': 2012}
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-29 18:47:56 [auto1.de] INFO: Saving data for UB59521: {'auction_closing_time': 1774886090.0, 'created_time': 1773382499.190441, 'last_price_update_time': 1774810076.260267}
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB59521') HTTP/1.1" 204 0
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-29 18:47:56 [auto1.de] INFO: Scrape type for EE25450: 0
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-29 18:47:56 [auto1.de] INFO: Scrape type for UC35648: 0
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-29 18:47:56 [auto1.de] INFO: Scrape type for TT34897: 2
2026-03-29 18:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-29 18:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f983f4c-065d-5952-8729-e67adaf03168 with scrape type 2
2026-03-29 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f983f4c-065d-5952-8729-e67adaf03168 with scrape type 2
2026-03-29 18:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f983f4c-065d-5952-8729-e67adaf03168, identifier: TT34897
2026-03-29 18:47:56 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-29 18:47:56 [auto1.de] INFO: Scrape type for KW39556: 2
2026-03-29 18:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556
2026-03-29 18:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 712182f4-dfca-5c1e-a988-8333c220bde5 with scrape type 2
2026-03-29 18:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 712182f4-dfca-5c1e-a988-8333c220bde5 with scrape type 2
2026-03-29 18:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 712182f4-dfca-5c1e-a988-8333c220bde5, identifier: KW39556
2026-03-29 18:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-29 18:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-29 18:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897 to the API
2026-03-29 18:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:41:57Z',
'fuel_type': 'petrol',
'id': '2f983f4c-065d-5952-8729-e67adaf03168',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT34897',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 134826,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-30',
'seller_name': None,
'title': 'Ford S-Max 2.0 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2011}
2026-03-29 18:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-29 18:47:57 [auto1.de] INFO: Saving data for TT34897: {'auction_closing_time': 1774885317.0, 'created_time': 1774608015.045552, 'last_price_update_time': 1774810077.388868}
2026-03-29 18:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT34897') HTTP/1.1" 204 0
2026-03-29 18:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556
2026-03-29 18:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556
2026-03-29 18:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 712182f4-dfca-5c1e-a988-8333c220bde5 with identifier: KW39556 to the API
2026-03-29 18:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:47:17Z',
'fuel_type': 'diesel',
'id': '712182f4-dfca-5c1e-a988-8333c220bde5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW39556',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Kombi',
'odometer': 209662,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-01',
'seller_name': None,
'title': 'Volkswagen T6 Kombi 2.0 TDI 4Motion',
'transmission': 'automatic',
'trim': '4Motion',
'year': 2018}
2026-03-29 18:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-29 18:47:58 [auto1.de] INFO: Saving data for KW39556: {'auction_closing_time': 1774885637.0, 'created_time': 1773224144.672645, 'last_price_update_time': 1774810078.956946}
2026-03-29 18:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW39556') HTTP/1.1" 204 0
2026-03-29 18:47:58 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-29 18:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-29 18:47:58 [auto1.de] INFO: Scrape type for KU38253: 2
2026-03-29 18:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-29 18:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84746ac-2602-5139-8e5d-b1962f4a5128 with scrape type 2
2026-03-29 18:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84746ac-2602-5139-8e5d-b1962f4a5128 with scrape type 2
2026-03-29 18:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d84746ac-2602-5139-8e5d-b1962f4a5128, identifier: KU38253
2026-03-29 18:47:59 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-29 18:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-29 18:47:59 [auto1.de] INFO: Scrape type for ZD67638: 2
2026-03-29 18:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638
2026-03-29 18:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab468ea0-8b9c-5757-997f-b75aefd95906 with scrape type 2
2026-03-29 18:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab468ea0-8b9c-5757-997f-b75aefd95906 with scrape type 2
2026-03-29 18:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab468ea0-8b9c-5757-997f-b75aefd95906, identifier: ZD67638
2026-03-29 18:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-29 18:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-29 18:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253 to the API
2026-03-29 18:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:21:29Z',
'fuel_type': 'petrol',
'id': 'd84746ac-2602-5139-8e5d-b1962f4a5128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU38253',
'listing': 'auction',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 40593,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-05',
'seller_name': None,
'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
'transmission': 'automatic',
'trim': 'VZ 4Drive',
'year': 2021}
2026-03-29 18:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-29 18:48:01 [auto1.de] INFO: Saving data for KU38253: {'auction_closing_time': 1774884089.0, 'created_time': 1773306876.57381, 'last_price_update_time': 1774810081.643276}
2026-03-29 18:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU38253') HTTP/1.1" 204 0
2026-03-29 18:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638
2026-03-29 18:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638
2026-03-29 18:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab468ea0-8b9c-5757-997f-b75aefd95906 with identifier: ZD67638 to the API
2026-03-29 18:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:18Z',
'fuel_type': 'petrol',
'id': 'ab468ea0-8b9c-5757-997f-b75aefd95906',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD67638',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 133971,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-18',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-29 18:48:02 [auto1.de] INFO: Saving data for ZD67638: {'auction_closing_time': 1774883898.0, 'created_time': 1774636658.052281, 'last_price_update_time': 1774810082.35595}
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD67638') HTTP/1.1" 204 0
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-29 18:48:02 [auto1.de] INFO: Scrape type for GW03247: 0
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-29 18:48:02 [auto1.de] INFO: Scrape type for TN24608: 2
2026-03-29 18:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-29 18:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c38a0a-6c60-5762-9944-f3756a021120 with scrape type 2
2026-03-29 18:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c38a0a-6c60-5762-9944-f3756a021120 with scrape type 2
2026-03-29 18:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06c38a0a-6c60-5762-9944-f3756a021120, identifier: TN24608
2026-03-29 18:48:02 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-29 18:48:02 [auto1.de] INFO: Scrape type for RZ07739: 2
2026-03-29 18:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-29 18:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73225278-d1dc-55fc-855c-ef4139203fff with scrape type 2
2026-03-29 18:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73225278-d1dc-55fc-855c-ef4139203fff with scrape type 2
2026-03-29 18:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73225278-d1dc-55fc-855c-ef4139203fff, identifier: RZ07739
2026-03-29 18:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-29 18:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608
2026-03-29 18:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06c38a0a-6c60-5762-9944-f3756a021120 with identifier: TN24608 to the API
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:10:53Z',
'fuel_type': 'diesel',
'id': '06c38a0a-6c60-5762-9944-f3756a021120',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN24608',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 155207,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi N-Connecta 4x4',
'transmission': 'manual',
'trim': 'N-Connecta 4x4',
'year': 2016}
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-29 18:48:02 [auto1.de] INFO: Saving data for TN24608: {'auction_closing_time': 1774883453.0, 'created_time': 1774522190.94557, 'last_price_update_time': 1774810082.911018}
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN24608') HTTP/1.1" 204 0
2026-03-29 18:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-29 18:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739
2026-03-29 18:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73225278-d1dc-55fc-855c-ef4139203fff with identifier: RZ07739 to the API
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:48:24Z',
'fuel_type': 'petrol',
'id': '73225278-d1dc-55fc-855c-ef4139203fff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ07739',
'listing': 'auction',
'make': 'Fiat',
'model': '500C',
'odometer': 32658,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-27',
'seller_name': None,
'title': 'Fiat 500C 1.0 Mild-Hybrid Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2021}
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-29 18:48:03 [auto1.de] INFO: Saving data for RZ07739: {'auction_closing_time': 1774885704.0, 'created_time': 1774521673.859668, 'last_price_update_time': 1774810083.300488}
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ07739') HTTP/1.1" 204 0
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-29 18:48:03 [auto1.de] INFO: Scrape type for TB14981: 2
2026-03-29 18:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-29 18:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e77e6e-db64-5fd3-a646-138ff878c268 with scrape type 2
2026-03-29 18:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31e77e6e-db64-5fd3-a646-138ff878c268 with scrape type 2
2026-03-29 18:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31e77e6e-db64-5fd3-a646-138ff878c268, identifier: TB14981
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-29 18:48:03 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-29 18:48:03 [auto1.de] INFO: Scrape type for BD92511: 2
2026-03-29 18:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-29 18:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950e75ad-f261-501d-92bb-cb2887c9412d with scrape type 2
2026-03-29 18:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950e75ad-f261-501d-92bb-cb2887c9412d with scrape type 2
2026-03-29 18:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 950e75ad-f261-501d-92bb-cb2887c9412d, identifier: BD92511
2026-03-29 18:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-29 18:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-29 18:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981 to the API
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:25:26Z',
'fuel_type': 'diesel',
'id': '31e77e6e-db64-5fd3-a646-138ff878c268',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB14981',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 265743,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-07-15',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2010}
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-29 18:48:03 [auto1.de] INFO: Saving data for TB14981: {'auction_closing_time': 1774884326.0, 'created_time': 1774608580.341538, 'last_price_update_time': 1774810083.873621}
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB14981') HTTP/1.1" 204 0
2026-03-29 18:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-29 18:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-29 18:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511 to the API
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:44:58Z',
'fuel_type': 'diesel',
'id': '950e75ad-f261-501d-92bb-cb2887c9412d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD92511',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 192950,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-26',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-29 18:48:04 [auto1.de] INFO: Saving data for BD92511: {'auction_closing_time': 1774885498.0, 'created_time': 1774292544.509362, 'last_price_update_time': 1774810084.231357}
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD92511') HTTP/1.1" 204 0
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-29 18:48:04 [auto1.de] INFO: Scrape type for ER30285: 0
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-29 18:48:04 [auto1.de] INFO: Scrape type for KS41473: 0
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-29 18:48:04 [auto1.de] INFO: Scrape type for MJ96775: 2
2026-03-29 18:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-29 18:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d185de4-05a5-57c4-b388-b5a20e358d07 with scrape type 2
2026-03-29 18:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d185de4-05a5-57c4-b388-b5a20e358d07 with scrape type 2
2026-03-29 18:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d185de4-05a5-57c4-b388-b5a20e358d07, identifier: MJ96775
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-29 18:48:04 [auto1.de] INFO: Scrape type for GT58505: 0
2026-03-29 18:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-29 18:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-29 18:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775 to the API
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:44:27Z',
'fuel_type': 'petrol',
'id': '0d185de4-05a5-57c4-b388-b5a20e358d07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ96775',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 143345,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-17',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-29 18:48:04 [auto1.de] INFO: Saving data for MJ96775: {'auction_closing_time': 1774885467.0, 'created_time': 1773383441.76919, 'last_price_update_time': 1774810084.759206}
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ96775') HTTP/1.1" 204 0
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-29 18:48:04 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-29 18:48:04 [auto1.de] INFO: Scrape type for NU47228: 2
2026-03-29 18:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-29 18:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466e3ba1-442e-5d10-b729-3c813070917a with scrape type 2
2026-03-29 18:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466e3ba1-442e-5d10-b729-3c813070917a with scrape type 2
2026-03-29 18:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466e3ba1-442e-5d10-b729-3c813070917a, identifier: NU47228
2026-03-29 18:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-29 18:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-29 18:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228 to the API
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:33:27Z',
'fuel_type': 'petrol',
'id': '466e3ba1-442e-5d10-b729-3c813070917a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU47228',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 118552,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-14',
'seller_name': None,
'title': "Renault Megane 1.6 Je t'aime",
'transmission': 'manual',
'trim': "Je t'aime",
'year': 2011}
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-29 18:48:05 [auto1.de] INFO: Saving data for NU47228: {'auction_closing_time': 1774884807.0, 'created_time': 1773401167.45213, 'last_price_update_time': 1774810085.28802}
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU47228') HTTP/1.1" 204 0
2026-03-29 18:48:05 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-29 18:48:05 [auto1.de] INFO: Scrape type for LB77280: 0
2026-03-29 18:48:05 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-29 18:48:05 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-29 18:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:06 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:06 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-29 18:48:06 [auto1.de] INFO: Scrape type for EA40469: 2
2026-03-29 18:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-29 18:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea29f7e-cce3-5300-b779-898fd8dd79f3 with scrape type 2
2026-03-29 18:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bea29f7e-cce3-5300-b779-898fd8dd79f3 with scrape type 2
2026-03-29 18:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bea29f7e-cce3-5300-b779-898fd8dd79f3, identifier: EA40469
2026-03-29 18:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-29 18:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-29 18:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469 to the API
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:25:07Z',
'fuel_type': 'petrol',
'id': 'bea29f7e-cce3-5300-b779-898fd8dd79f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA40469',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 142888,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-08',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2013}
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-29 18:48:06 [auto1.de] INFO: Saving data for EA40469: {'auction_closing_time': 1774884307.0, 'created_time': 1774608045.731351, 'last_price_update_time': 1774810086.505351}
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA40469') HTTP/1.1" 204 0
2026-03-29 18:48:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:06 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-29 18:48:06 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-29 18:48:06 [auto1.de] INFO: Scrape type for NX83651: 2
2026-03-29 18:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-29 18:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de8fa7f-5417-5574-a78b-1bdb61662d9f with scrape type 2
2026-03-29 18:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de8fa7f-5417-5574-a78b-1bdb61662d9f with scrape type 2
2026-03-29 18:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de8fa7f-5417-5574-a78b-1bdb61662d9f, identifier: NX83651
2026-03-29 18:48:06 [scrapy.extensions.logstats] INFO: Crawled 148 pages (at 8 pages/min), scraped 1303 items (at 90 items/min)
2026-03-29 18:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-29 18:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-29 18:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651 to the API
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:41:21Z',
'fuel_type': 'petrol',
'id': '9de8fa7f-5417-5574-a78b-1bdb61662d9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX83651',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 127594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-23',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBoost Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-29 18:48:06 [auto1.de] INFO: Saving data for NX83651: {'auction_closing_time': 1774885281.0, 'created_time': 1773227981.692358, 'last_price_update_time': 1774810086.961355}
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX83651') HTTP/1.1" 204 0
2026-03-29 18:48:06 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-29 18:48:06 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-29 18:48:06 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-29 18:48:06 [auto1.de] INFO: Scrape type for ET23804: 2
2026-03-29 18:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-29 18:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d231d52e-7650-57a0-bcba-4ce9774fcb0c with scrape type 2
2026-03-29 18:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d231d52e-7650-57a0-bcba-4ce9774fcb0c with scrape type 2
2026-03-29 18:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d231d52e-7650-57a0-bcba-4ce9774fcb0c, identifier: ET23804
2026-03-29 18:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-29 18:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804
2026-03-29 18:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d231d52e-7650-57a0-bcba-4ce9774fcb0c with identifier: ET23804 to the API
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:10:27Z',
'fuel_type': 'petrol',
'id': 'd231d52e-7650-57a0-bcba-4ce9774fcb0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET23804',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 113136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-04',
'seller_name': None,
'title': 'Peugeot 3008 1.6 THP Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2014}
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-29 18:48:07 [auto1.de] INFO: Saving data for ET23804: {'auction_closing_time': 1774883427.0, 'created_time': 1773946964.963343, 'last_price_update_time': 1774810087.368109}
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET23804') HTTP/1.1" 204 0
2026-03-29 18:48:07 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-29 18:48:07 [auto1.de] INFO: Scrape type for FZ16195: 2
2026-03-29 18:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-29 18:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b313f4b8-a704-58de-820f-6f7a018d6704 with scrape type 2
2026-03-29 18:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b313f4b8-a704-58de-820f-6f7a018d6704 with scrape type 2
2026-03-29 18:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b313f4b8-a704-58de-820f-6f7a018d6704, identifier: FZ16195
2026-03-29 18:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-29 18:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-29 18:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195 to the API
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:49:03Z',
'fuel_type': 'diesel',
'id': 'b313f4b8-a704-58de-820f-6f7a018d6704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ16195',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 194715,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-02',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2012}
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-29 18:48:07 [auto1.de] INFO: Saving data for FZ16195: {'auction_closing_time': 1774885743.0, 'created_time': 1774608197.075871, 'last_price_update_time': 1774810087.904821}
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ16195') HTTP/1.1" 204 0
2026-03-29 18:48:07 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-29 18:48:07 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-29 18:48:07 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-29 18:48:07 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79198%27 HTTP/1.1" 200 None
2026-03-29 18:48:07 [auto1.de] INFO: Scrape type for SS79198: 2
2026-03-29 18:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198
2026-03-29 18:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with scrape type 2
2026-03-29 18:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with scrape type 2
2026-03-29 18:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77, identifier: SS79198
2026-03-29 18:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198
2026-03-29 18:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198
2026-03-29 18:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77 with identifier: SS79198 to the API
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:36:44Z',
'fuel_type': 'petrol',
'id': '6ea99c3a-21d7-5a3d-b55a-2ab19a2d9b77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS79198',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 93476,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-27',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2013}
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79198%27 HTTP/1.1" 200 None
2026-03-29 18:48:08 [auto1.de] INFO: Saving data for SS79198: {'auction_closing_time': 1774885004.0, 'created_time': 1774034329.086343, 'last_price_update_time': 1774810088.31614}
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS79198') HTTP/1.1" 204 0
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-29 18:48:08 [auto1.de] INFO: Scrape type for NP30819: 0
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-29 18:48:08 [auto1.de] INFO: Scrape type for WK96887: 0
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-29 18:48:08 [auto1.de] INFO: Scrape type for UT28734: 0
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-29 18:48:08 [auto1.de] INFO: Scrape type for JH61376: 2
2026-03-29 18:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376
2026-03-29 18:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab3910c-8064-549f-b55e-28642a91d9b9 with scrape type 2
2026-03-29 18:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab3910c-8064-549f-b55e-28642a91d9b9 with scrape type 2
2026-03-29 18:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab3910c-8064-549f-b55e-28642a91d9b9, identifier: JH61376
2026-03-29 18:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376
2026-03-29 18:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376
2026-03-29 18:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab3910c-8064-549f-b55e-28642a91d9b9 with identifier: JH61376 to the API
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:41:05Z',
'fuel_type': 'petrol',
'id': 'dab3910c-8064-549f-b55e-28642a91d9b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH61376',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 33121,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-13',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG',
'transmission': 'automatic',
'trim': '4Matic AMG',
'year': 2014}
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-29 18:48:08 [auto1.de] INFO: Saving data for JH61376: {'auction_closing_time': 1774885265.0, 'created_time': 1774550157.10966, 'last_price_update_time': 1774810088.764806}
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH61376') HTTP/1.1" 204 0
2026-03-29 18:48:08 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-29 18:48:08 [auto1.de] INFO: Scrape type for SD45668: 2
2026-03-29 18:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-29 18:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71046146-e93c-553f-b627-7916516e0c27 with scrape type 2
2026-03-29 18:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71046146-e93c-553f-b627-7916516e0c27 with scrape type 2
2026-03-29 18:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71046146-e93c-553f-b627-7916516e0c27, identifier: SD45668
2026-03-29 18:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-29 18:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-29 18:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668 to the API
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:54:54Z',
'fuel_type': 'diesel',
'id': '71046146-e93c-553f-b627-7916516e0c27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD45668',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 230322,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-03',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 250 CDI T BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Elegance',
'year': 2010}
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-29 18:48:09 [auto1.de] INFO: Saving data for SD45668: {'auction_closing_time': 1774886094.0, 'created_time': 1773646538.524547, 'last_price_update_time': 1774810089.303039}
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD45668') HTTP/1.1" 204 0
2026-03-29 18:48:09 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-29 18:48:09 [auto1.de] INFO: Scrape type for KK39591: 0
2026-03-29 18:48:09 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-29 18:48:09 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-29 18:48:09 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-29 18:48:09 [auto1.de] INFO: Scrape type for FP92588: 2
2026-03-29 18:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-29 18:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa3c882-164d-5314-acbc-ed8d77b17f77 with scrape type 2
2026-03-29 18:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efa3c882-164d-5314-acbc-ed8d77b17f77 with scrape type 2
2026-03-29 18:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efa3c882-164d-5314-acbc-ed8d77b17f77, identifier: FP92588
2026-03-29 18:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-29 18:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-29 18:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588 to the API
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:45:12Z',
'fuel_type': 'petrol',
'id': 'efa3c882-164d-5314-acbc-ed8d77b17f77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP92588',
'listing': 'auction',
'make': 'Honda',
'model': 'Civic',
'odometer': 66848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-18',
'seller_name': None,
'title': 'Honda Civic 2.0 VTEC Type-R GT',
'transmission': 'manual',
'trim': 'Type-R GT',
'year': 2018}
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-29 18:48:09 [auto1.de] INFO: Saving data for FP92588: {'auction_closing_time': 1774885512.0, 'created_time': 1773400835.273956, 'last_price_update_time': 1774810089.768469}
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP92588') HTTP/1.1" 204 0
2026-03-29 18:48:09 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-29 18:48:09 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-29 18:48:09 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-29 18:48:09 [auto1.de] INFO: Scrape type for KH38301: 2
2026-03-29 18:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301
2026-03-29 18:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00438067-5874-5c4f-9f8b-9ab2e9067e23 with scrape type 2
2026-03-29 18:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00438067-5874-5c4f-9f8b-9ab2e9067e23 with scrape type 2
2026-03-29 18:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00438067-5874-5c4f-9f8b-9ab2e9067e23, identifier: KH38301
2026-03-29 18:48:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301
2026-03-29 18:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301
2026-03-29 18:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00438067-5874-5c4f-9f8b-9ab2e9067e23 with identifier: KH38301 to the API
2026-03-29 18:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:23:05Z',
'fuel_type': 'petrol',
'id': '00438067-5874-5c4f-9f8b-9ab2e9067e23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH38301',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 79309,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-20',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2018}
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Saving data for KH38301: {'auction_closing_time': 1774884185.0, 'created_time': 1774034476.73897, 'last_price_update_time': 1774810090.169222}
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH38301') HTTP/1.1" 204 0
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Scrape type for XV47877: 0
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Scrape type for XF17671: 0
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Scrape type for ZT05209: 2
2026-03-29 18:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-29 18:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with scrape type 2
2026-03-29 18:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with scrape type 2
2026-03-29 18:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea43bf3f-14e4-5c4b-be29-baceb9ab1174, identifier: ZT05209
2026-03-29 18:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-29 18:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-29 18:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209 to the API
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:44:20Z',
'fuel_type': 'petrol',
'id': 'ea43bf3f-14e4-5c4b-be29-baceb9ab1174',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT05209',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Aveo',
'odometer': 154341,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-19',
'seller_name': None,
'title': 'Chevrolet Aveo 1.4 LS',
'transmission': 'manual',
'trim': 'LS',
'year': 2012}
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Saving data for ZT05209: {'auction_closing_time': 1774885460.0, 'created_time': 1773946598.484195, 'last_price_update_time': 1774810090.647967}
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT05209') HTTP/1.1" 204 0
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Scrape type for VE08810: 0
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Scrape type for NB45839: 0
2026-03-29 18:48:10 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-29 18:48:10 [auto1.de] INFO: Scrape type for BD21444: 2
2026-03-29 18:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444
2026-03-29 18:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbd677c3-4ade-5461-ba8e-ec215f69ff6d with scrape type 2
2026-03-29 18:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbd677c3-4ade-5461-ba8e-ec215f69ff6d with scrape type 2
2026-03-29 18:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbd677c3-4ade-5461-ba8e-ec215f69ff6d, identifier: BD21444
2026-03-29 18:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444
2026-03-29 18:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444
2026-03-29 18:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbd677c3-4ade-5461-ba8e-ec215f69ff6d with identifier: BD21444 to the API
2026-03-29 18:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:58:59Z',
'fuel_type': 'diesel',
'id': 'cbd677c3-4ade-5461-ba8e-ec215f69ff6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD21444',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 166778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-25',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-29 18:48:11 [auto1.de] INFO: Saving data for BD21444: {'auction_closing_time': 1774886339.0, 'created_time': 1773225611.074423, 'last_price_update_time': 1774810091.187712}
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD21444') HTTP/1.1" 204 0
2026-03-29 18:48:11 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:11 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-29 18:48:11 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-29 18:48:11 [auto1.de] INFO: Scrape type for WH58707: 2
2026-03-29 18:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707
2026-03-29 18:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with scrape type 2
2026-03-29 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with scrape type 2
2026-03-29 18:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfc387fa-2d1f-59bc-becd-b4eb83d55a23, identifier: WH58707
2026-03-29 18:48:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707
2026-03-29 18:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707
2026-03-29 18:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfc387fa-2d1f-59bc-becd-b4eb83d55a23 with identifier: WH58707 to the API
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 67,
'expiration_date': '2026-03-30T15:55:04Z',
'fuel_type': 'petrol',
'id': 'bfc387fa-2d1f-59bc-becd-b4eb83d55a23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH58707',
'listing': 'auction',
'make': 'Kia',
'model': 'Picanto',
'odometer': 46491,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-13',
'seller_name': None,
'title': 'Kia Picanto 1.0 Edition 7',
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2019}
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-29 18:48:11 [auto1.de] INFO: Saving data for WH58707: {'auction_closing_time': 1774886104.0, 'created_time': 1773945881.470466, 'last_price_update_time': 1774810091.610873}
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH58707') HTTP/1.1" 204 0
2026-03-29 18:48:11 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-29 18:48:11 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-29 18:48:11 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-29 18:48:11 [auto1.de] INFO: Scrape type for DP78752: 2
2026-03-29 18:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752
2026-03-29 18:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f3b16c-7b69-558f-ae1a-0202161177f3 with scrape type 2
2026-03-29 18:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f3b16c-7b69-558f-ae1a-0202161177f3 with scrape type 2
2026-03-29 18:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33f3b16c-7b69-558f-ae1a-0202161177f3, identifier: DP78752
2026-03-29 18:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752
2026-03-29 18:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752
2026-03-29 18:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33f3b16c-7b69-558f-ae1a-0202161177f3 with identifier: DP78752 to the API
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:24:28Z',
'fuel_type': 'petrol',
'id': '33f3b16c-7b69-558f-ae1a-0202161177f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP78752',
'listing': 'auction',
'make': 'Audi',
'model': 'TTS',
'odometer': 131471,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-31',
'seller_name': None,
'title': 'Audi TTS 2.0 TFSI quattro Coupe',
'transmission': 'automatic',
'trim': 'quattro Coupe',
'year': 2016}
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-29 18:48:12 [auto1.de] INFO: Saving data for DP78752: {'auction_closing_time': 1774884268.0, 'created_time': 1773308194.344215, 'last_price_update_time': 1774810092.017182}
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP78752') HTTP/1.1" 204 0
2026-03-29 18:48:12 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-29 18:48:12 [auto1.de] INFO: Scrape type for XW71594: 2
2026-03-29 18:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594
2026-03-29 18:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebcae088-b63d-5c7f-9581-689b769b3cad with scrape type 2
2026-03-29 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebcae088-b63d-5c7f-9581-689b769b3cad with scrape type 2
2026-03-29 18:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebcae088-b63d-5c7f-9581-689b769b3cad, identifier: XW71594
2026-03-29 18:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594
2026-03-29 18:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594
2026-03-29 18:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebcae088-b63d-5c7f-9581-689b769b3cad with identifier: XW71594 to the API
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:42:37Z',
'fuel_type': 'diesel',
'id': 'ebcae088-b63d-5c7f-9581-689b769b3cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW71594',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 164758,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-23',
'seller_name': None,
'title': 'BMW 5er 520d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2018}
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-29 18:48:12 [auto1.de] INFO: Saving data for XW71594: {'auction_closing_time': 1774885357.0, 'created_time': 1773229706.359796, 'last_price_update_time': 1774810092.426698}
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW71594') HTTP/1.1" 204 0
2026-03-29 18:48:12 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-29 18:48:12 [auto1.de] INFO: Scrape type for PZ33404: 2
2026-03-29 18:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-29 18:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd00e2f0-2ede-5f93-9455-2fc8e143f02c with scrape type 2
2026-03-29 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd00e2f0-2ede-5f93-9455-2fc8e143f02c with scrape type 2
2026-03-29 18:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd00e2f0-2ede-5f93-9455-2fc8e143f02c, identifier: PZ33404
2026-03-29 18:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-29 18:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-29 18:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404 to the API
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:32:09Z',
'fuel_type': 'petrol',
'id': 'dd00e2f0-2ede-5f93-9455-2fc8e143f02c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ33404',
'listing': 'auction',
'make': 'Seat',
'model': 'Exeo',
'odometer': 214317,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-09',
'seller_name': None,
'title': 'Seat Exeo 2.0 TFSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2010}
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-29 18:48:12 [auto1.de] INFO: Saving data for PZ33404: {'auction_closing_time': 1774884729.0, 'created_time': 1774294800.553846, 'last_price_update_time': 1774810092.86592}
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ33404') HTTP/1.1" 204 0
2026-03-29 18:48:12 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-29 18:48:12 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-29 18:48:12 [auto1.de] INFO: Scrape type for VT41344: 2
2026-03-29 18:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-29 18:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b88936e-3414-5b11-8023-bd9586466aec with scrape type 2
2026-03-29 18:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b88936e-3414-5b11-8023-bd9586466aec with scrape type 2
2026-03-29 18:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b88936e-3414-5b11-8023-bd9586466aec, identifier: VT41344
2026-03-29 18:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-29 18:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344
2026-03-29 18:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b88936e-3414-5b11-8023-bd9586466aec with identifier: VT41344 to the API
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:30:15Z',
'fuel_type': 'diesel',
'id': '2b88936e-3414-5b11-8023-bd9586466aec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT41344',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 219034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-02',
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-29 18:48:13 [auto1.de] INFO: Saving data for VT41344: {'auction_closing_time': 1774884615.0, 'created_time': 1774521577.971607, 'last_price_update_time': 1774810093.373709}
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT41344') HTTP/1.1" 204 0
2026-03-29 18:48:13 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-29 18:48:13 [auto1.de] INFO: Scrape type for MK98498: 2
2026-03-29 18:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498
2026-03-29 18:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with scrape type 2
2026-03-29 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with scrape type 2
2026-03-29 18:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa, identifier: MK98498
2026-03-29 18:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498
2026-03-29 18:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498
2026-03-29 18:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97482e3a-6c60-5566-88cc-c1cb73cfb2fa with identifier: MK98498 to the API
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:06:44Z',
'fuel_type': 'diesel',
'id': '97482e3a-6c60-5566-88cc-c1cb73cfb2fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK98498',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 84614,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-29',
'seller_name': None,
'title': 'BMW 1er 116d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2018}
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-29 18:48:13 [auto1.de] INFO: Saving data for MK98498: {'auction_closing_time': 1774883204.0, 'created_time': 1774350848.132728, 'last_price_update_time': 1774810093.769652}
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK98498') HTTP/1.1" 204 0
2026-03-29 18:48:13 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-29 18:48:13 [auto1.de] INFO: Scrape type for FH98757: 2
2026-03-29 18:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-29 18:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558baaeb-a376-5287-927d-0b0dba5a804e with scrape type 2
2026-03-29 18:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 558baaeb-a376-5287-927d-0b0dba5a804e with scrape type 2
2026-03-29 18:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 558baaeb-a376-5287-927d-0b0dba5a804e, identifier: FH98757
2026-03-29 18:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-29 18:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757
2026-03-29 18:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 558baaeb-a376-5287-927d-0b0dba5a804e with identifier: FH98757 to the API
2026-03-29 18:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:34:57Z',
'fuel_type': 'diesel',
'id': '558baaeb-a376-5287-927d-0b0dba5a804e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH98757',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'CC',
'odometer': 179423,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-07-14',
'seller_name': None,
'title': 'Volkswagen CC 2.0 TDI BlueMotion Tech',
'transmission': 'automatic',
'trim': 'BlueMotion Tech',
'year': 2013}
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-29 18:48:14 [auto1.de] INFO: Saving data for FH98757: {'auction_closing_time': 1774884897.0, 'created_time': 1773429394.454008, 'last_price_update_time': 1774810094.214271}
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH98757') HTTP/1.1" 204 0
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-29 18:48:14 [auto1.de] INFO: Scrape type for CV09356: 0
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-29 18:48:14 [auto1.de] INFO: Scrape type for AC92366: 2
2026-03-29 18:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-29 18:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 574ab418-ac0d-594a-810b-d4b8e3b255c9 with scrape type 2
2026-03-29 18:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 574ab418-ac0d-594a-810b-d4b8e3b255c9 with scrape type 2
2026-03-29 18:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 574ab418-ac0d-594a-810b-d4b8e3b255c9, identifier: AC92366
2026-03-29 18:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-29 18:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366
2026-03-29 18:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 574ab418-ac0d-594a-810b-d4b8e3b255c9 with identifier: AC92366 to the API
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:18:30Z',
'fuel_type': 'petrol',
'id': '574ab418-ac0d-594a-810b-d4b8e3b255c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC92366',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 115274,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-13',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2009}
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-29 18:48:14 [auto1.de] INFO: Saving data for AC92366: {'auction_closing_time': 1774883910.0, 'created_time': 1774522514.911213, 'last_price_update_time': 1774810094.637975}
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC92366') HTTP/1.1" 204 0
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-29 18:48:14 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW96816%27 HTTP/1.1" 200 None
2026-03-29 18:48:14 [auto1.de] INFO: Scrape type for PW96816: 2
2026-03-29 18:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816
2026-03-29 18:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21d48e29-2624-5dd5-9f06-ff897585b51b with scrape type 2
2026-03-29 18:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21d48e29-2624-5dd5-9f06-ff897585b51b with scrape type 2
2026-03-29 18:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21d48e29-2624-5dd5-9f06-ff897585b51b, identifier: PW96816
2026-03-29 18:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816
2026-03-29 18:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816
2026-03-29 18:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21d48e29-2624-5dd5-9f06-ff897585b51b with identifier: PW96816 to the API
2026-03-29 18:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:50:01Z',
'fuel_type': 'diesel',
'id': '21d48e29-2624-5dd5-9f06-ff897585b51b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW96816',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 134005,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-10',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Trend',
'transmission': 'automatic',
'trim': '320 L1 Trend',
'year': 2018}
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW96816%27 HTTP/1.1" 200 None
2026-03-29 18:48:15 [auto1.de] INFO: Saving data for PW96816: {'auction_closing_time': 1774885801.0, 'created_time': 1774723387.2015, 'last_price_update_time': 1774810095.12624}
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW96816') HTTP/1.1" 204 0
2026-03-29 18:48:15 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-29 18:48:15 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU61936%27 HTTP/1.1" 200 None
2026-03-29 18:48:15 [auto1.de] INFO: Scrape type for JU61936: 2
2026-03-29 18:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936
2026-03-29 18:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1bf0bf-fc4c-5c64-a965-a3459921a58e with scrape type 2
2026-03-29 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb1bf0bf-fc4c-5c64-a965-a3459921a58e with scrape type 2
2026-03-29 18:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb1bf0bf-fc4c-5c64-a965-a3459921a58e, identifier: JU61936
2026-03-29 18:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936
2026-03-29 18:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936
2026-03-29 18:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb1bf0bf-fc4c-5c64-a965-a3459921a58e with identifier: JU61936 to the API
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:25:06Z',
'fuel_type': 'petrol',
'id': 'bb1bf0bf-fc4c-5c64-a965-a3459921a58e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU61936',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 143765,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-11',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.2 TSI Style BlueMotion',
'transmission': 'manual',
'trim': 'Style BlueMotion',
'year': 2011}
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU61936%27 HTTP/1.1" 200 None
2026-03-29 18:48:15 [auto1.de] INFO: Saving data for JU61936: {'auction_closing_time': 1774884306.0, 'created_time': 1774723389.354714, 'last_price_update_time': 1774810095.531801}
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU61936') HTTP/1.1" 204 0
2026-03-29 18:48:15 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-29 18:48:15 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY38947%27 HTTP/1.1" 200 None
2026-03-29 18:48:15 [auto1.de] INFO: Scrape type for FY38947: 2
2026-03-29 18:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947
2026-03-29 18:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f460e6-70f5-5b2f-973e-7666d6174c0d with scrape type 2
2026-03-29 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f460e6-70f5-5b2f-973e-7666d6174c0d with scrape type 2
2026-03-29 18:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f460e6-70f5-5b2f-973e-7666d6174c0d, identifier: FY38947
2026-03-29 18:48:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947
2026-03-29 18:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947
2026-03-29 18:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f460e6-70f5-5b2f-973e-7666d6174c0d with identifier: FY38947 to the API
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:22:00Z',
'fuel_type': 'petrol',
'id': 'c7f460e6-70f5-5b2f-973e-7666d6174c0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY38947',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 61646,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-22',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 TGDI GT",
'transmission': 'automatic',
'trim': 'GT',
'year': 2020}
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY38947%27 HTTP/1.1" 200 None
2026-03-29 18:48:15 [auto1.de] INFO: Saving data for FY38947: {'auction_closing_time': 1774884120.0, 'created_time': 1774035473.419426, 'last_price_update_time': 1774810095.926246}
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY38947') HTTP/1.1" 204 0
2026-03-29 18:48:15 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU41228%27 HTTP/1.1" 200 None
2026-03-29 18:48:15 [auto1.de] INFO: Scrape type for MU41228: 2
2026-03-29 18:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228
2026-03-29 18:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b39126-8880-5af3-bfae-3e9b86b14547 with scrape type 2
2026-03-29 18:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b39126-8880-5af3-bfae-3e9b86b14547 with scrape type 2
2026-03-29 18:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15b39126-8880-5af3-bfae-3e9b86b14547, identifier: MU41228
2026-03-29 18:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228
2026-03-29 18:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228
2026-03-29 18:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15b39126-8880-5af3-bfae-3e9b86b14547 with identifier: MU41228 to the API
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:24:58Z',
'fuel_type': 'diesel',
'id': '15b39126-8880-5af3-bfae-3e9b86b14547',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU41228',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 304254,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-11',
'seller_name': None,
'title': 'Peugeot Partner 1.6 HDi Origin',
'transmission': 'manual',
'trim': 'Origin',
'year': 2009}
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU41228%27 HTTP/1.1" 200 None
2026-03-29 18:48:16 [auto1.de] INFO: Saving data for MU41228: {'auction_closing_time': 1774884298.0, 'created_time': 1774723388.870135, 'last_price_update_time': 1774810096.357003}
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU41228') HTTP/1.1" 204 0
2026-03-29 18:48:16 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG13141%27 HTTP/1.1" 200 None
2026-03-29 18:48:16 [auto1.de] INFO: Scrape type for NG13141: 2
2026-03-29 18:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141
2026-03-29 18:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 821683dd-d9c2-5258-9db6-b842fe922965 with scrape type 2
2026-03-29 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 821683dd-d9c2-5258-9db6-b842fe922965 with scrape type 2
2026-03-29 18:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 821683dd-d9c2-5258-9db6-b842fe922965, identifier: NG13141
2026-03-29 18:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141
2026-03-29 18:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141
2026-03-29 18:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 821683dd-d9c2-5258-9db6-b842fe922965 with identifier: NG13141 to the API
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:45:04Z',
'fuel_type': 'diesel',
'id': '821683dd-d9c2-5258-9db6-b842fe922965',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG13141',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 224018,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-07',
'seller_name': None,
'title': 'Renault Talisman 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2016}
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG13141%27 HTTP/1.1" 200 None
2026-03-29 18:48:16 [auto1.de] INFO: Saving data for NG13141: {'auction_closing_time': 1774885504.0, 'created_time': 1773400327.105054, 'last_price_update_time': 1774810096.753182}
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG13141') HTTP/1.1" 204 0
2026-03-29 18:48:16 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:16 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-29 18:48:16 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP15722%27 HTTP/1.1" 200 None
2026-03-29 18:48:16 [auto1.de] INFO: Scrape type for BP15722: 2
2026-03-29 18:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722
2026-03-29 18:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028472ce-5239-552b-a1ef-ba45981de032 with scrape type 2
2026-03-29 18:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028472ce-5239-552b-a1ef-ba45981de032 with scrape type 2
2026-03-29 18:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 028472ce-5239-552b-a1ef-ba45981de032, identifier: BP15722
2026-03-29 18:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722
2026-03-29 18:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722
2026-03-29 18:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 028472ce-5239-552b-a1ef-ba45981de032 with identifier: BP15722 to the API
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:37:29Z',
'fuel_type': 'petrol',
'id': '028472ce-5239-552b-a1ef-ba45981de032',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP15722',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 187029,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-04',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2010}
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP15722%27 HTTP/1.1" 200 None
2026-03-29 18:48:17 [auto1.de] INFO: Saving data for BP15722: {'auction_closing_time': 1774885049.0, 'created_time': 1774723389.736258, 'last_price_update_time': 1774810097.240367}
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP15722') HTTP/1.1" 204 0
2026-03-29 18:48:17 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST53597%27 HTTP/1.1" 200 None
2026-03-29 18:48:17 [auto1.de] INFO: Scrape type for ST53597: 2
2026-03-29 18:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597
2026-03-29 18:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff15e21-ea19-53d5-a886-a085381ed24d with scrape type 2
2026-03-29 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cff15e21-ea19-53d5-a886-a085381ed24d with scrape type 2
2026-03-29 18:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cff15e21-ea19-53d5-a886-a085381ed24d, identifier: ST53597
2026-03-29 18:48:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:17 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-29 18:48:17 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG70940%27 HTTP/1.1" 200 None
2026-03-29 18:48:17 [auto1.de] INFO: Scrape type for PG70940: 2
2026-03-29 18:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940
2026-03-29 18:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with scrape type 2
2026-03-29 18:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with scrape type 2
2026-03-29 18:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b, identifier: PG70940
2026-03-29 18:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597
2026-03-29 18:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597
2026-03-29 18:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cff15e21-ea19-53d5-a886-a085381ed24d with identifier: ST53597 to the API
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:54:50Z',
'fuel_type': 'diesel',
'id': 'cff15e21-ea19-53d5-a886-a085381ed24d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST53597',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 93502,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-18',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 290 L1 Sport',
'transmission': 'automatic',
'trim': '290 L1 Sport',
'year': 2020}
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST53597%27 HTTP/1.1" 200 None
2026-03-29 18:48:17 [auto1.de] INFO: Saving data for ST53597: {'auction_closing_time': 1774886090.0, 'created_time': 1774034797.511256, 'last_price_update_time': 1774810097.747213}
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST53597') HTTP/1.1" 204 0
2026-03-29 18:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940
2026-03-29 18:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940
2026-03-29 18:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b with identifier: PG70940 to the API
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:38:19Z',
'fuel_type': 'diesel',
'id': 'ca14ecdc-9a22-5dc0-9dc1-ff736512fa2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG70940',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 89678,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-27',
'seller_name': None,
'title': 'Peugeot Expert 1.6 Blue-HDi Active L2',
'transmission': 'manual',
'trim': 'Active L2',
'year': 2017}
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG70940%27 HTTP/1.1" 200 None
2026-03-29 18:48:18 [auto1.de] INFO: Saving data for PG70940: {'auction_closing_time': 1774885099.0, 'created_time': 1774349937.53173, 'last_price_update_time': 1774810098.031082}
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG70940') HTTP/1.1" 204 0
2026-03-29 18:48:18 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD05986%27 HTTP/1.1" 200 None
2026-03-29 18:48:18 [auto1.de] INFO: Scrape type for AD05986: 2
2026-03-29 18:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986
2026-03-29 18:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cf225da-2a58-56b8-b448-e400028bd87b with scrape type 2
2026-03-29 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cf225da-2a58-56b8-b448-e400028bd87b with scrape type 2
2026-03-29 18:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cf225da-2a58-56b8-b448-e400028bd87b, identifier: AD05986
2026-03-29 18:48:18 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-29 18:48:18 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ96267%27 HTTP/1.1" 200 None
2026-03-29 18:48:18 [auto1.de] INFO: Scrape type for YJ96267: 2
2026-03-29 18:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267
2026-03-29 18:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e90c296e-02ed-5bbd-850c-17af6f33c829 with scrape type 2
2026-03-29 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e90c296e-02ed-5bbd-850c-17af6f33c829 with scrape type 2
2026-03-29 18:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e90c296e-02ed-5bbd-850c-17af6f33c829, identifier: YJ96267
2026-03-29 18:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986
2026-03-29 18:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986
2026-03-29 18:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cf225da-2a58-56b8-b448-e400028bd87b with identifier: AD05986 to the API
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:03:54Z',
'fuel_type': 'petrol',
'id': '8cf225da-2a58-56b8-b448-e400028bd87b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD05986',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 16265,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-12',
'seller_name': None,
'title': 'MINI John Cooper Works Trim',
'transmission': 'manual',
'trim': 'Trim',
'year': 2023}
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD05986%27 HTTP/1.1" 200 None
2026-03-29 18:48:18 [auto1.de] INFO: Saving data for AD05986: {'auction_closing_time': 1774883034.0, 'created_time': 1773381310.45263, 'last_price_update_time': 1774810098.529068}
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD05986') HTTP/1.1" 204 0
2026-03-29 18:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267
2026-03-29 18:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267
2026-03-29 18:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e90c296e-02ed-5bbd-850c-17af6f33c829 with identifier: YJ96267 to the API
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:17:28Z',
'fuel_type': 'diesel',
'id': 'e90c296e-02ed-5bbd-850c-17af6f33c829',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ96267',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 74291,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-23',
'seller_name': None,
'title': 'BMW 2er 220d Gran Tourer xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2020}
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ96267%27 HTTP/1.1" 200 None
2026-03-29 18:48:18 [auto1.de] INFO: Saving data for YJ96267: {'auction_closing_time': 1774883848.0, 'created_time': 1774723392.569287, 'last_price_update_time': 1774810098.811325}
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ96267') HTTP/1.1" 204 0
2026-03-29 18:48:18 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-29 18:48:18 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT09019%27 HTTP/1.1" 200 None
2026-03-29 18:48:18 [auto1.de] INFO: Scrape type for WT09019: 2
2026-03-29 18:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019
2026-03-29 18:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with scrape type 2
2026-03-29 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with scrape type 2
2026-03-29 18:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5d772ec-2436-5b77-a935-26c1aa1fcaf6, identifier: WT09019
2026-03-29 18:48:18 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45975%27 HTTP/1.1" 200 None
2026-03-29 18:48:18 [auto1.de] INFO: Scrape type for BH45975: 2
2026-03-29 18:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975
2026-03-29 18:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7e7246-4e93-53a6-8339-35dbb94b1040 with scrape type 2
2026-03-29 18:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7e7246-4e93-53a6-8339-35dbb94b1040 with scrape type 2
2026-03-29 18:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e7e7246-4e93-53a6-8339-35dbb94b1040, identifier: BH45975
2026-03-29 18:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019
2026-03-29 18:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019
2026-03-29 18:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5d772ec-2436-5b77-a935-26c1aa1fcaf6 with identifier: WT09019 to the API
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:18:00Z',
'fuel_type': 'diesel',
'id': 'c5d772ec-2436-5b77-a935-26c1aa1fcaf6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT09019',
'listing': 'auction',
'make': 'Seat',
'model': 'Ateca',
'odometer': 127855,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seller_name': None,
'title': 'Seat Ateca 2.0 TDI Xperience',
'transmission': 'automatic',
'trim': 'Xperience',
'year': 2022}
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT09019%27 HTTP/1.1" 200 None
2026-03-29 18:48:19 [auto1.de] INFO: Saving data for WT09019: {'auction_closing_time': 1774883880.0, 'created_time': 1774033579.901319, 'last_price_update_time': 1774810099.322032}
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT09019') HTTP/1.1" 204 0
2026-03-29 18:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975
2026-03-29 18:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975
2026-03-29 18:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e7e7246-4e93-53a6-8339-35dbb94b1040 with identifier: BH45975 to the API
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 292,
'expiration_date': '2026-03-30T15:54:55Z',
'fuel_type': 'petrol',
'id': '9e7e7246-4e93-53a6-8339-35dbb94b1040',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH45975',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 91163,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-14',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'BlueEfficiency Avantgarde',
'year': 2011}
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45975%27 HTTP/1.1" 200 None
2026-03-29 18:48:19 [auto1.de] INFO: Saving data for BH45975: {'auction_closing_time': 1774886095.0, 'created_time': 1774003289.594634, 'last_price_update_time': 1774810099.70696}
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH45975') HTTP/1.1" 204 0
2026-03-29 18:48:19 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-29 18:48:19 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-29 18:48:19 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-29 18:48:19 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-29 18:48:19 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX97123%27 HTTP/1.1" 200 None
2026-03-29 18:48:19 [auto1.de] INFO: Scrape type for AX97123: 2
2026-03-29 18:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123
2026-03-29 18:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with scrape type 2
2026-03-29 18:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with scrape type 2
2026-03-29 18:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b, identifier: AX97123
2026-03-29 18:48:19 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30878%27 HTTP/1.1" 200 None
2026-03-29 18:48:19 [auto1.de] INFO: Scrape type for JS30878: 2
2026-03-29 18:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878
2026-03-29 18:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with scrape type 2
2026-03-29 18:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with scrape type 2
2026-03-29 18:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89, identifier: JS30878
2026-03-29 18:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123
2026-03-29 18:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123
2026-03-29 18:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27ac1122-fa14-5da3-b8e4-e6f17c136b6b with identifier: AX97123 to the API
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:39:21Z',
'fuel_type': 'hybrid',
'id': '27ac1122-fa14-5da3-b8e4-e6f17c136b6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX97123',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 90022,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-24',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid Prime 4WD',
'transmission': 'automatic',
'trim': 'Prime 4WD',
'year': 2022}
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX97123%27 HTTP/1.1" 200 None
2026-03-29 18:48:20 [auto1.de] INFO: Saving data for AX97123: {'auction_closing_time': 1774885161.0, 'created_time': 1773382880.223848, 'last_price_update_time': 1774810100.243568}
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX97123') HTTP/1.1" 204 0
2026-03-29 18:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878
2026-03-29 18:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878
2026-03-29 18:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89 with identifier: JS30878 to the API
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:24:37Z',
'fuel_type': 'petrol',
'id': '77ddd5e8-be0a-5564-8a9d-9c2ea91cfe89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS30878',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 160889,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-05-28',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30878%27 HTTP/1.1" 200 None
2026-03-29 18:48:20 [auto1.de] INFO: Saving data for JS30878: {'auction_closing_time': 1774884277.0, 'created_time': 1774349876.786243, 'last_price_update_time': 1774810100.530669}
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS30878') HTTP/1.1" 204 0
2026-03-29 18:48:20 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-29 18:48:20 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW92608%27 HTTP/1.1" 200 None
2026-03-29 18:48:20 [auto1.de] INFO: Scrape type for ZW92608: 2
2026-03-29 18:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608
2026-03-29 18:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with scrape type 2
2026-03-29 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with scrape type 2
2026-03-29 18:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de, identifier: ZW92608
2026-03-29 18:48:20 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-29 18:48:20 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF10236%27 HTTP/1.1" 200 None
2026-03-29 18:48:20 [auto1.de] INFO: Scrape type for LF10236: 2
2026-03-29 18:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236
2026-03-29 18:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with scrape type 2
2026-03-29 18:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with scrape type 2
2026-03-29 18:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb, identifier: LF10236
2026-03-29 18:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608
2026-03-29 18:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608
2026-03-29 18:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9d0dd00-ae34-5f0e-9b6c-7056e003a8de with identifier: ZW92608 to the API
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:35:34Z',
'fuel_type': 'diesel',
'id': 'b9d0dd00-ae34-5f0e-9b6c-7056e003a8de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW92608',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 215505,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-20',
'seller_name': None,
'title': 'Volvo XC60 2.4 D4 Summum AWD',
'transmission': 'automatic',
'trim': 'Summum AWD',
'year': 2012}
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW92608%27 HTTP/1.1" 200 None
2026-03-29 18:48:21 [auto1.de] INFO: Saving data for ZW92608: {'auction_closing_time': 1774884934.0, 'created_time': 1774034040.632428, 'last_price_update_time': 1774810101.060889}
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW92608') HTTP/1.1" 204 0
2026-03-29 18:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236
2026-03-29 18:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236
2026-03-29 18:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb with identifier: LF10236 to the API
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:56:55Z',
'fuel_type': 'diesel',
'id': 'ecf73b50-8c4d-58d5-9222-fde5aaa9f4eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF10236',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 160356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-30',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2007}
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF10236%27 HTTP/1.1" 200 None
2026-03-29 18:48:21 [auto1.de] INFO: Saving data for LF10236: {'auction_closing_time': 1774886215.0, 'created_time': 1774034872.800773, 'last_price_update_time': 1774810101.357059}
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF10236') HTTP/1.1" 204 0
2026-03-29 18:48:21 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-29 18:48:21 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE00984%27 HTTP/1.1" 200 None
2026-03-29 18:48:21 [auto1.de] INFO: Scrape type for CE00984: 2
2026-03-29 18:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984
2026-03-29 18:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91421c51-844c-5260-bc5c-579c13056393 with scrape type 2
2026-03-29 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91421c51-844c-5260-bc5c-579c13056393 with scrape type 2
2026-03-29 18:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91421c51-844c-5260-bc5c-579c13056393, identifier: CE00984
2026-03-29 18:48:21 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-29 18:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984
2026-03-29 18:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984
2026-03-29 18:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91421c51-844c-5260-bc5c-579c13056393 with identifier: CE00984 to the API
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:27:29Z',
'fuel_type': 'diesel',
'id': '91421c51-844c-5260-bc5c-579c13056393',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE00984',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 405894,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-19',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'BlueEfficiency Avantgarde',
'year': 2010}
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE00984%27 HTTP/1.1" 200 None
2026-03-29 18:48:21 [auto1.de] INFO: Saving data for CE00984: {'auction_closing_time': 1774884449.0, 'created_time': 1774723397.258451, 'last_price_update_time': 1774810101.742628}
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE00984') HTTP/1.1" 204 0
2026-03-29 18:48:21 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-29 18:48:21 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-29 18:48:21 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-29 18:48:21 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS70589%27 HTTP/1.1" 200 None
2026-03-29 18:48:21 [auto1.de] INFO: Scrape type for CS70589: 2
2026-03-29 18:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589
2026-03-29 18:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e25abb8-4370-5462-bcf6-373f9a4ab23a with scrape type 2
2026-03-29 18:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e25abb8-4370-5462-bcf6-373f9a4ab23a with scrape type 2
2026-03-29 18:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e25abb8-4370-5462-bcf6-373f9a4ab23a, identifier: CS70589
2026-03-29 18:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589
2026-03-29 18:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589
2026-03-29 18:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e25abb8-4370-5462-bcf6-373f9a4ab23a with identifier: CS70589 to the API
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:04:30Z',
'fuel_type': 'petrol',
'id': '7e25abb8-4370-5462-bcf6-373f9a4ab23a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS70589',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 233668,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-30',
'seller_name': None,
'title': 'Renault Clio 1.2 TomTom Edition',
'transmission': 'manual',
'trim': 'TomTom Edition',
'year': 2012}
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS70589%27 HTTP/1.1" 200 None
2026-03-29 18:48:22 [auto1.de] INFO: Saving data for CS70589: {'auction_closing_time': 1774883070.0, 'created_time': 1774723395.286613, 'last_price_update_time': 1774810102.236036}
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS70589') HTTP/1.1" 204 0
2026-03-29 18:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:22 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK47455%27 HTTP/1.1" 200 None
2026-03-29 18:48:22 [auto1.de] INFO: Scrape type for MK47455: 2
2026-03-29 18:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455
2026-03-29 18:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15876a88-6fa7-5b4b-9523-f36ede4301ad with scrape type 2
2026-03-29 18:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15876a88-6fa7-5b4b-9523-f36ede4301ad with scrape type 2
2026-03-29 18:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15876a88-6fa7-5b4b-9523-f36ede4301ad, identifier: MK47455
2026-03-29 18:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455
2026-03-29 18:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455
2026-03-29 18:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15876a88-6fa7-5b4b-9523-f36ede4301ad with identifier: MK47455 to the API
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:06:15Z',
'fuel_type': 'diesel',
'id': '15876a88-6fa7-5b4b-9523-f36ede4301ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK47455',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 132804,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-30',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Bi-Turbo Vignale',
'transmission': 'automatic',
'trim': 'Vignale',
'year': 2016}
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK47455%27 HTTP/1.1" 200 None
2026-03-29 18:48:22 [auto1.de] INFO: Saving data for MK47455: {'auction_closing_time': 1774883175.0, 'created_time': 1773400200.573552, 'last_price_update_time': 1774810102.658348}
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK47455') HTTP/1.1" 204 0
2026-03-29 18:48:22 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND12794%27 HTTP/1.1" 200 None
2026-03-29 18:48:22 [auto1.de] INFO: Scrape type for ND12794: 2
2026-03-29 18:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794
2026-03-29 18:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e2c115-6248-547a-b360-0908d130dbf2 with scrape type 2
2026-03-29 18:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e2c115-6248-547a-b360-0908d130dbf2 with scrape type 2
2026-03-29 18:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e2c115-6248-547a-b360-0908d130dbf2, identifier: ND12794
2026-03-29 18:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794
2026-03-29 18:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794
2026-03-29 18:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e2c115-6248-547a-b360-0908d130dbf2 with identifier: ND12794 to the API
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:43:53Z',
'fuel_type': 'gas',
'id': '89e2c115-6248-547a-b360-0908d130dbf2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND12794',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 71596,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-06',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Prestige',
'transmission': 'manual',
'trim': 'Stepway Prestige',
'year': 2020}
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND12794%27 HTTP/1.1" 200 None
2026-03-29 18:48:23 [auto1.de] INFO: Saving data for ND12794: {'auction_closing_time': 1774885433.0, 'created_time': 1774723396.823628, 'last_price_update_time': 1774810103.087803}
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND12794') HTTP/1.1" 204 0
2026-03-29 18:48:23 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63260%27 HTTP/1.1" 200 None
2026-03-29 18:48:23 [auto1.de] INFO: Scrape type for TW63260: 2
2026-03-29 18:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260
2026-03-29 18:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with scrape type 2
2026-03-29 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with scrape type 2
2026-03-29 18:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81, identifier: TW63260
2026-03-29 18:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260
2026-03-29 18:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260
2026-03-29 18:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c4fd3b9-2428-5c30-9fb1-8bea8045ab81 with identifier: TW63260 to the API
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:43:06Z',
'fuel_type': 'diesel',
'id': '7c4fd3b9-2428-5c30-9fb1-8bea8045ab81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW63260',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 181108,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-28',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport & Style BlueMotion Tech',
'year': 2013}
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63260%27 HTTP/1.1" 200 None
2026-03-29 18:48:23 [auto1.de] INFO: Saving data for TW63260: {'auction_closing_time': 1774885386.0, 'created_time': 1774723448.243374, 'last_price_update_time': 1774810103.495902}
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW63260') HTTP/1.1" 204 0
2026-03-29 18:48:23 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:23 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE34706%27 HTTP/1.1" 200 None
2026-03-29 18:48:23 [auto1.de] INFO: Scrape type for SE34706: 2
2026-03-29 18:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706
2026-03-29 18:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f1e013e-73fb-57ba-9512-38d9f3ff51af with scrape type 2
2026-03-29 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f1e013e-73fb-57ba-9512-38d9f3ff51af with scrape type 2
2026-03-29 18:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f1e013e-73fb-57ba-9512-38d9f3ff51af, identifier: SE34706
2026-03-29 18:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706
2026-03-29 18:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706
2026-03-29 18:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f1e013e-73fb-57ba-9512-38d9f3ff51af with identifier: SE34706 to the API
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:58:37Z',
'fuel_type': 'diesel',
'id': '3f1e013e-73fb-57ba-9512-38d9f3ff51af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE34706',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 279532,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-22',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2015}
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE34706%27 HTTP/1.1" 200 None
2026-03-29 18:48:23 [auto1.de] INFO: Saving data for SE34706: {'auction_closing_time': 1774886317.0, 'created_time': 1774349880.003415, 'last_price_update_time': 1774810103.888791}
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE34706') HTTP/1.1" 204 0
2026-03-29 18:48:23 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN91174%27 HTTP/1.1" 200 None
2026-03-29 18:48:23 [auto1.de] INFO: Scrape type for AN91174: 2
2026-03-29 18:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174
2026-03-29 18:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa975e98-e574-5d82-a43b-60ac841a91e2 with scrape type 2
2026-03-29 18:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa975e98-e574-5d82-a43b-60ac841a91e2 with scrape type 2
2026-03-29 18:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa975e98-e574-5d82-a43b-60ac841a91e2, identifier: AN91174
2026-03-29 18:48:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM77711%27 HTTP/1.1" 200 None
2026-03-29 18:48:24 [auto1.de] INFO: Scrape type for NM77711: 2
2026-03-29 18:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711
2026-03-29 18:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1827aa-97f3-57e3-948a-a93f50948e8b with scrape type 2
2026-03-29 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d1827aa-97f3-57e3-948a-a93f50948e8b with scrape type 2
2026-03-29 18:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d1827aa-97f3-57e3-948a-a93f50948e8b, identifier: NM77711
2026-03-29 18:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174
2026-03-29 18:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174
2026-03-29 18:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa975e98-e574-5d82-a43b-60ac841a91e2 with identifier: AN91174 to the API
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-30T15:17:19Z',
'fuel_type': 'petrol',
'id': 'aa975e98-e574-5d82-a43b-60ac841a91e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN91174',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 91937,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-02',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
'transmission': 'automatic',
'trim': 'GTI TCR',
'year': 2019}
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN91174%27 HTTP/1.1" 200 None
2026-03-29 18:48:24 [auto1.de] INFO: Saving data for AN91174: {'auction_closing_time': 1774883839.0, 'created_time': 1774035509.919991, 'last_price_update_time': 1774810104.387189}
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN91174') HTTP/1.1" 204 0
2026-03-29 18:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711
2026-03-29 18:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711
2026-03-29 18:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d1827aa-97f3-57e3-948a-a93f50948e8b with identifier: NM77711 to the API
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:38:13Z',
'fuel_type': 'petrol',
'id': '8d1827aa-97f3-57e3-948a-a93f50948e8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM77711',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 20434,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-18',
'seller_name': None,
'title': 'Dacia Logan MCV 0.9 TCe Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2020}
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM77711%27 HTTP/1.1" 200 None
2026-03-29 18:48:24 [auto1.de] INFO: Saving data for NM77711: {'auction_closing_time': 1774885093.0, 'created_time': 1774034451.540025, 'last_price_update_time': 1774810104.769873}
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM77711') HTTP/1.1" 204 0
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF19813%27 HTTP/1.1" 200 None
2026-03-29 18:48:24 [auto1.de] INFO: Scrape type for AF19813: 0
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08847%27 HTTP/1.1" 200 None
2026-03-29 18:48:24 [auto1.de] INFO: Scrape type for DK08847: 2
2026-03-29 18:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847
2026-03-29 18:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with scrape type 2
2026-03-29 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with scrape type 2
2026-03-29 18:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e, identifier: DK08847
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-29 18:48:24 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM15553%27 HTTP/1.1" 200 None
2026-03-29 18:48:24 [auto1.de] INFO: Scrape type for SM15553: 2
2026-03-29 18:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553
2026-03-29 18:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d016a437-a9ac-5ffb-ab79-34404855a8f6 with scrape type 2
2026-03-29 18:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d016a437-a9ac-5ffb-ab79-34404855a8f6 with scrape type 2
2026-03-29 18:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d016a437-a9ac-5ffb-ab79-34404855a8f6, identifier: SM15553
2026-03-29 18:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847
2026-03-29 18:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847
2026-03-29 18:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ff7d604-859c-5d1c-aaa9-25d8eff6c39e with identifier: DK08847 to the API
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:03:13Z',
'fuel_type': 'diesel',
'id': '5ff7d604-859c-5d1c-aaa9-25d8eff6c39e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK08847',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 180898,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-10',
'seller_name': None,
'title': 'BMW 3er 320d Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2016}
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08847%27 HTTP/1.1" 200 None
2026-03-29 18:48:25 [auto1.de] INFO: Saving data for DK08847: {'auction_closing_time': 1774882993.0, 'created_time': 1773429294.650338, 'last_price_update_time': 1774810105.283654}
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK08847') HTTP/1.1" 204 0
2026-03-29 18:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553
2026-03-29 18:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553
2026-03-29 18:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d016a437-a9ac-5ffb-ab79-34404855a8f6 with identifier: SM15553 to the API
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:45:35Z',
'fuel_type': 'petrol',
'id': 'd016a437-a9ac-5ffb-ab79-34404855a8f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM15553',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 101046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-23',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2012}
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM15553%27 HTTP/1.1" 200 None
2026-03-29 18:48:25 [auto1.de] INFO: Saving data for SM15553: {'auction_closing_time': 1774885535.0, 'created_time': 1774118738.840991, 'last_price_update_time': 1774810105.60144}
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM15553') HTTP/1.1" 204 0
2026-03-29 18:48:25 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB87569%27 HTTP/1.1" 200 None
2026-03-29 18:48:25 [auto1.de] INFO: Scrape type for JB87569: 2
2026-03-29 18:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569
2026-03-29 18:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with scrape type 2
2026-03-29 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with scrape type 2
2026-03-29 18:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c46d4d1f-223a-5808-aa67-4217f9c6d7b0, identifier: JB87569
2026-03-29 18:48:25 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-29 18:48:25 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-29 18:48:25 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78340%27 HTTP/1.1" 200 None
2026-03-29 18:48:25 [auto1.de] INFO: Scrape type for WM78340: 2
2026-03-29 18:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340
2026-03-29 18:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with scrape type 2
2026-03-29 18:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with scrape type 2
2026-03-29 18:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0, identifier: WM78340
2026-03-29 18:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569
2026-03-29 18:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569
2026-03-29 18:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c46d4d1f-223a-5808-aa67-4217f9c6d7b0 with identifier: JB87569 to the API
2026-03-29 18:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:31:57Z',
'fuel_type': 'diesel',
'id': 'c46d4d1f-223a-5808-aa67-4217f9c6d7b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB87569',
'listing': 'auction',
'make': 'Mazda',
'model': '3',
'odometer': 136506,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-01',
'seller_name': None,
'title': 'Mazda 3 2.2 Turbodiesel Exclusive-Line',
'transmission': 'automatic',
'trim': 'Exclusive-Line',
'year': 2018}
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB87569%27 HTTP/1.1" 200 None
2026-03-29 18:48:26 [auto1.de] INFO: Saving data for JB87569: {'auction_closing_time': 1774884717.0, 'created_time': 1774035030.760261, 'last_price_update_time': 1774810106.115739}
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB87569') HTTP/1.1" 204 0
2026-03-29 18:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340
2026-03-29 18:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340
2026-03-29 18:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e0a2b6a-51b4-5b23-9088-06031bb1aed0 with identifier: WM78340 to the API
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:39:15Z',
'fuel_type': 'diesel',
'id': '9e0a2b6a-51b4-5b23-9088-06031bb1aed0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM78340',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 157609,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-07',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Highline 4Motion BlueMotion',
'transmission': 'manual',
'trim': 'Highline 4Motion BlueMotion',
'year': 2014}
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78340%27 HTTP/1.1" 200 None
2026-03-29 18:48:26 [auto1.de] INFO: Saving data for WM78340: {'auction_closing_time': 1774885155.0, 'created_time': 1774723400.446605, 'last_price_update_time': 1774810106.40699}
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM78340') HTTP/1.1" 204 0
2026-03-29 18:48:26 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-29 18:48:26 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-29 18:48:26 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA77613%27 HTTP/1.1" 200 None
2026-03-29 18:48:26 [auto1.de] INFO: Scrape type for TA77613: 2
2026-03-29 18:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613
2026-03-29 18:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with scrape type 2
2026-03-29 18:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with scrape type 2
2026-03-29 18:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e, identifier: TA77613
2026-03-29 18:48:26 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-29 18:48:26 [auto1.de] INFO: Scrape type for NF79967: 2
2026-03-29 18:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967
2026-03-29 18:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with scrape type 2
2026-03-29 18:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with scrape type 2
2026-03-29 18:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae, identifier: NF79967
2026-03-29 18:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613
2026-03-29 18:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613
2026-03-29 18:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e with identifier: TA77613 to the API
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:19:03Z',
'fuel_type': 'diesel',
'id': '46b7ce35-f59b-5436-a5ff-4d2dc5ae1e9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA77613',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 123932,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-16',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 300 L2 Trend',
'transmission': 'manual',
'trim': '300 L2 Trend',
'year': 2019}
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA77613%27 HTTP/1.1" 200 None
2026-03-29 18:48:26 [auto1.de] INFO: Saving data for TA77613: {'auction_closing_time': 1774883943.0, 'created_time': 1774350026.958277, 'last_price_update_time': 1774810106.966594}
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA77613') HTTP/1.1" 204 0
2026-03-29 18:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967
2026-03-29 18:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967
2026-03-29 18:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73563d6b-fd9d-594d-ad15-b694bbd1b4ae with identifier: NF79967 to the API
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:40:21Z',
'fuel_type': 'petrol',
'id': '73563d6b-fd9d-594d-ad15-b694bbd1b4ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF79967',
'listing': 'auction',
'make': 'Skoda',
'model': 'Citigo',
'odometer': 68991,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-08-29',
'seller_name': None,
'title': 'Skoda Citigo 1.0 MPI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2013}
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-29 18:48:27 [auto1.de] INFO: Saving data for NF79967: {'auction_closing_time': 1774885221.0, 'created_time': 1774002403.064803, 'last_price_update_time': 1774810107.343034}
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF79967') HTTP/1.1" 204 0
2026-03-29 18:48:27 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-29 18:48:27 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77268%27 HTTP/1.1" 200 None
2026-03-29 18:48:27 [auto1.de] INFO: Scrape type for DW77268: 2
2026-03-29 18:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268
2026-03-29 18:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with scrape type 2
2026-03-29 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with scrape type 2
2026-03-29 18:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f5ff589-3999-55fb-9871-1125f3d8c1f3, identifier: DW77268
2026-03-29 18:48:27 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP86172%27 HTTP/1.1" 200 None
2026-03-29 18:48:27 [auto1.de] INFO: Scrape type for BP86172: 2
2026-03-29 18:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172
2026-03-29 18:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764982c2-d5a5-59a9-9565-62649ecb4113 with scrape type 2
2026-03-29 18:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764982c2-d5a5-59a9-9565-62649ecb4113 with scrape type 2
2026-03-29 18:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764982c2-d5a5-59a9-9565-62649ecb4113, identifier: BP86172
2026-03-29 18:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268
2026-03-29 18:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268
2026-03-29 18:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f5ff589-3999-55fb-9871-1125f3d8c1f3 with identifier: DW77268 to the API
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:43:03Z',
'fuel_type': 'petrol',
'id': '1f5ff589-3999-55fb-9871-1125f3d8c1f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77268',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 90669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-24',
'seller_name': None,
'title': 'BMW X1 xDrive 20i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2016}
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77268%27 HTTP/1.1" 200 None
2026-03-29 18:48:27 [auto1.de] INFO: Saving data for DW77268: {'auction_closing_time': 1774885383.0, 'created_time': 1774723409.690335, 'last_price_update_time': 1774810107.841113}
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW77268') HTTP/1.1" 204 0
2026-03-29 18:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172
2026-03-29 18:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172
2026-03-29 18:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764982c2-d5a5-59a9-9565-62649ecb4113 with identifier: BP86172 to the API
2026-03-29 18:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:16Z',
'fuel_type': 'diesel',
'id': '764982c2-d5a5-59a9-9565-62649ecb4113',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP86172',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 58263,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-19',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Join',
'transmission': 'automatic',
'trim': 'Join',
'year': 2018}
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP86172%27 HTTP/1.1" 200 None
2026-03-29 18:48:28 [auto1.de] INFO: Saving data for BP86172: {'auction_closing_time': 1774885456.0, 'created_time': 1774723443.001817, 'last_price_update_time': 1774810108.144558}
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP86172') HTTP/1.1" 204 0
2026-03-29 18:48:28 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ18232%27 HTTP/1.1" 200 None
2026-03-29 18:48:28 [auto1.de] INFO: Scrape type for DJ18232: 2
2026-03-29 18:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232
2026-03-29 18:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with scrape type 2
2026-03-29 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with scrape type 2
2026-03-29 18:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18e095dc-76d5-542e-ad86-0bbcbda00bc8, identifier: DJ18232
2026-03-29 18:48:28 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-29 18:48:28 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-29 18:48:28 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR99893%27 HTTP/1.1" 200 None
2026-03-29 18:48:28 [auto1.de] INFO: Scrape type for LR99893: 2
2026-03-29 18:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893
2026-03-29 18:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aee5aa4-74e8-5913-9a47-9b82b1139669 with scrape type 2
2026-03-29 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aee5aa4-74e8-5913-9a47-9b82b1139669 with scrape type 2
2026-03-29 18:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aee5aa4-74e8-5913-9a47-9b82b1139669, identifier: LR99893
2026-03-29 18:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232
2026-03-29 18:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232
2026-03-29 18:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18e095dc-76d5-542e-ad86-0bbcbda00bc8 with identifier: DJ18232 to the API
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:37:43Z',
'fuel_type': 'diesel',
'id': '18e095dc-76d5-542e-ad86-0bbcbda00bc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ18232',
'listing': 'auction',
'make': 'Citroen',
'model': 'C6',
'odometer': 193139,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-08-23',
'seller_name': None,
'title': 'Citroen C6 2.7 V6 HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2007}
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ18232%27 HTTP/1.1" 200 None
2026-03-29 18:48:28 [auto1.de] INFO: Saving data for DJ18232: {'auction_closing_time': 1774885063.0, 'created_time': 1773340730.026669, 'last_price_update_time': 1774810108.634221}
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ18232') HTTP/1.1" 204 0
2026-03-29 18:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893
2026-03-29 18:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893
2026-03-29 18:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aee5aa4-74e8-5913-9a47-9b82b1139669 with identifier: LR99893 to the API
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:21:50Z',
'fuel_type': 'diesel',
'id': '5aee5aa4-74e8-5913-9a47-9b82b1139669',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR99893',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T5 Multivan',
'odometer': 278451,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-06',
'seller_name': None,
'title': 'Volkswagen T5 Multivan 2.0 TDI Startline 4Motion',
'transmission': 'manual',
'trim': 'Startline 4Motion',
'year': 2012}
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR99893%27 HTTP/1.1" 200 None
2026-03-29 18:48:28 [auto1.de] INFO: Saving data for LR99893: {'auction_closing_time': 1774884110.0, 'created_time': 1774032137.478875, 'last_price_update_time': 1774810108.911605}
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR99893') HTTP/1.1" 204 0
2026-03-29 18:48:28 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL54518%27 HTTP/1.1" 200 None
2026-03-29 18:48:28 [auto1.de] INFO: Scrape type for RL54518: 2
2026-03-29 18:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518
2026-03-29 18:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0decc8e8-f0d5-573f-8287-e02d11350115 with scrape type 2
2026-03-29 18:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0decc8e8-f0d5-573f-8287-e02d11350115 with scrape type 2
2026-03-29 18:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0decc8e8-f0d5-573f-8287-e02d11350115, identifier: RL54518
2026-03-29 18:48:29 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG16481%27 HTTP/1.1" 200 None
2026-03-29 18:48:29 [auto1.de] INFO: Scrape type for VG16481: 2
2026-03-29 18:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481
2026-03-29 18:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f771b4c2-53af-5e31-8e08-62f444b96b4e with scrape type 2
2026-03-29 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f771b4c2-53af-5e31-8e08-62f444b96b4e with scrape type 2
2026-03-29 18:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f771b4c2-53af-5e31-8e08-62f444b96b4e, identifier: VG16481
2026-03-29 18:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518
2026-03-29 18:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518
2026-03-29 18:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0decc8e8-f0d5-573f-8287-e02d11350115 with identifier: RL54518 to the API
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:22:57Z',
'fuel_type': 'diesel',
'id': '0decc8e8-f0d5-573f-8287-e02d11350115',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL54518',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 31516,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-05',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2023}
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL54518%27 HTTP/1.1" 200 None
2026-03-29 18:48:29 [auto1.de] INFO: Saving data for RL54518: {'auction_closing_time': 1774884177.0, 'created_time': 1774349941.155665, 'last_price_update_time': 1774810109.452971}
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL54518') HTTP/1.1" 204 0
2026-03-29 18:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481
2026-03-29 18:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481
2026-03-29 18:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f771b4c2-53af-5e31-8e08-62f444b96b4e with identifier: VG16481 to the API
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:37:44Z',
'fuel_type': 'hybrid',
'id': 'f771b4c2-53af-5e31-8e08-62f444b96b4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG16481',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 44016,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-13',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.4 PHEV Plus Spirit 4WD',
'transmission': 'automatic',
'trim': 'Plus Spirit 4WD',
'year': 2021}
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG16481%27 HTTP/1.1" 200 None
2026-03-29 18:48:29 [auto1.de] INFO: Saving data for VG16481: {'auction_closing_time': 1774885064.0, 'created_time': 1774350918.953161, 'last_price_update_time': 1774810109.74204}
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG16481') HTTP/1.1" 204 0
2026-03-29 18:48:29 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-29 18:48:29 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS03100%27 HTTP/1.1" 200 None
2026-03-29 18:48:29 [auto1.de] INFO: Scrape type for GS03100: 2
2026-03-29 18:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100
2026-03-29 18:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with scrape type 2
2026-03-29 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with scrape type 2
2026-03-29 18:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8, identifier: GS03100
2026-03-29 18:48:29 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-29 18:48:29 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19268%27 HTTP/1.1" 200 None
2026-03-29 18:48:29 [auto1.de] INFO: Scrape type for PH19268: 2
2026-03-29 18:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268
2026-03-29 18:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with scrape type 2
2026-03-29 18:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with scrape type 2
2026-03-29 18:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf, identifier: PH19268
2026-03-29 18:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100
2026-03-29 18:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100
2026-03-29 18:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8 with identifier: GS03100 to the API
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:00:13Z',
'fuel_type': 'petrol',
'id': '6ac1a0bd-cf4a-5511-b7ff-43bc6ebc2ce8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS03100',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 90805,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-15',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'manual',
'trim': 'Shine',
'year': 2019}
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS03100%27 HTTP/1.1" 200 None
2026-03-29 18:48:30 [auto1.de] INFO: Saving data for GS03100: {'auction_closing_time': 1774882813.0, 'created_time': 1774723427.684049, 'last_price_update_time': 1774810110.245619}
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS03100') HTTP/1.1" 204 0
2026-03-29 18:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268
2026-03-29 18:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268
2026-03-29 18:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf with identifier: PH19268 to the API
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:09:40Z',
'fuel_type': 'petrol',
'id': 'd7ac79dc-d07b-58fb-baa5-0dcc5cb89ddf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH19268',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 143362,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-11',
'seller_name': None,
'title': 'Suzuki Swift 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2007}
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19268%27 HTTP/1.1" 200 None
2026-03-29 18:48:30 [auto1.de] INFO: Saving data for PH19268: {'auction_closing_time': 1774883380.0, 'created_time': 1774032198.291858, 'last_price_update_time': 1774810110.62009}
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH19268') HTTP/1.1" 204 0
2026-03-29 18:48:30 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC21553%27 HTTP/1.1" 200 None
2026-03-29 18:48:30 [auto1.de] INFO: Scrape type for FC21553: 2
2026-03-29 18:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-03-29 18:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with scrape type 2
2026-03-29 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with scrape type 2
2026-03-29 18:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827, identifier: FC21553
2026-03-29 18:48:30 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-29 18:48:30 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU80535%27 HTTP/1.1" 200 None
2026-03-29 18:48:30 [auto1.de] INFO: Scrape type for PU80535: 2
2026-03-29 18:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535
2026-03-29 18:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16dab28-6f90-57a5-aab9-cb6e0853871b with scrape type 2
2026-03-29 18:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f16dab28-6f90-57a5-aab9-cb6e0853871b with scrape type 2
2026-03-29 18:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f16dab28-6f90-57a5-aab9-cb6e0853871b, identifier: PU80535
2026-03-29 18:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-03-29 18:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553
2026-03-29 18:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc0d039-5b42-53e5-b0a9-2ef0d870a827 with identifier: FC21553 to the API
2026-03-29 18:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:27:08Z',
'fuel_type': 'diesel',
'id': '4cc0d039-5b42-53e5-b0a9-2ef0d870a827',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC21553',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 207486,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-25',
'seller_name': None,
'title': 'Volvo XC60 2.4 D4 Kinetic AWD',
'transmission': 'automatic',
'trim': 'Kinetic AWD',
'year': 2016}
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC21553%27 HTTP/1.1" 200 None
2026-03-29 18:48:31 [auto1.de] INFO: Saving data for FC21553: {'auction_closing_time': 1774884428.0, 'created_time': 1774723437.028269, 'last_price_update_time': 1774810111.3365}
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC21553') HTTP/1.1" 204 0
2026-03-29 18:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535
2026-03-29 18:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535
2026-03-29 18:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f16dab28-6f90-57a5-aab9-cb6e0853871b with identifier: PU80535 to the API
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:15:13Z',
'fuel_type': 'gas',
'id': 'f16dab28-6f90-57a5-aab9-cb6e0853871b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU80535',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 118896,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-28',
'seller_name': None,
'title': 'Seat Leon 1.5 TGI Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2019}
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU80535%27 HTTP/1.1" 200 None
2026-03-29 18:48:31 [auto1.de] INFO: Saving data for PU80535: {'auction_closing_time': 1774883713.0, 'created_time': 1774723464.44285, 'last_price_update_time': 1774810111.635426}
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU80535') HTTP/1.1" 204 0
2026-03-29 18:48:31 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT45397%27 HTTP/1.1" 200 None
2026-03-29 18:48:31 [auto1.de] INFO: Scrape type for CT45397: 0
2026-03-29 18:48:31 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-29 18:48:31 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-29 18:48:31 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ92426%27 HTTP/1.1" 200 None
2026-03-29 18:48:31 [auto1.de] INFO: Scrape type for FZ92426: 2
2026-03-29 18:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426
2026-03-29 18:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with scrape type 2
2026-03-29 18:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with scrape type 2
2026-03-29 18:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4, identifier: FZ92426
2026-03-29 18:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426
2026-03-29 18:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426
2026-03-29 18:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c760fd3c-3cd8-5fbb-9fae-b8d2243602c4 with identifier: FZ92426 to the API
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:56:36Z',
'fuel_type': 'petrol',
'id': 'c760fd3c-3cd8-5fbb-9fae-b8d2243602c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ92426',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 125240,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-13',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ92426%27 HTTP/1.1" 200 None
2026-03-29 18:48:32 [auto1.de] INFO: Saving data for FZ92426: {'auction_closing_time': 1774886196.0, 'created_time': 1774723431.727927, 'last_price_update_time': 1774810112.056177}
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ92426') HTTP/1.1" 204 0
2026-03-29 18:48:32 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE77380%27 HTTP/1.1" 200 None
2026-03-29 18:48:32 [auto1.de] INFO: Scrape type for RE77380: 2
2026-03-29 18:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380
2026-03-29 18:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d32b32be-5e8b-5028-9490-b30aa4690b08 with scrape type 2
2026-03-29 18:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d32b32be-5e8b-5028-9490-b30aa4690b08 with scrape type 2
2026-03-29 18:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d32b32be-5e8b-5028-9490-b30aa4690b08, identifier: RE77380
2026-03-29 18:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380
2026-03-29 18:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380
2026-03-29 18:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d32b32be-5e8b-5028-9490-b30aa4690b08 with identifier: RE77380 to the API
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:06:41Z',
'fuel_type': 'petrol',
'id': 'd32b32be-5e8b-5028-9490-b30aa4690b08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE77380',
'listing': 'auction',
'make': 'Toyota',
'model': 'Corolla Verso',
'odometer': 220200,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-16',
'seller_name': None,
'title': 'Toyota Corolla Verso 1.8 Sol',
'transmission': 'manual',
'trim': 'Sol',
'year': 2003}
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE77380%27 HTTP/1.1" 200 None
2026-03-29 18:48:32 [auto1.de] INFO: Saving data for RE77380: {'auction_closing_time': 1774883201.0, 'created_time': 1774723428.319872, 'last_price_update_time': 1774810112.445398}
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE77380') HTTP/1.1" 204 0
2026-03-29 18:48:32 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-29 18:48:32 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-29 18:48:32 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-29 18:48:32 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY32657%27 HTTP/1.1" 200 None
2026-03-29 18:48:32 [auto1.de] INFO: Scrape type for ZY32657: 2
2026-03-29 18:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657
2026-03-29 18:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9567e7f1-df59-575f-b013-ae275086f652 with scrape type 2
2026-03-29 18:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9567e7f1-df59-575f-b013-ae275086f652 with scrape type 2
2026-03-29 18:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9567e7f1-df59-575f-b013-ae275086f652, identifier: ZY32657
2026-03-29 18:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657
2026-03-29 18:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657
2026-03-29 18:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9567e7f1-df59-575f-b013-ae275086f652 with identifier: ZY32657 to the API
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:07:24Z',
'fuel_type': 'petrol',
'id': '9567e7f1-df59-575f-b013-ae275086f652',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY32657',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 164076,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-08',
'seller_name': None,
'title': 'Honda Jazz 1.4 Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2009}
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY32657%27 HTTP/1.1" 200 None
2026-03-29 18:48:32 [auto1.de] INFO: Saving data for ZY32657: {'auction_closing_time': 1774883244.0, 'created_time': 1774723643.32614, 'last_price_update_time': 1774810112.857859}
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY32657') HTTP/1.1" 204 0
2026-03-29 18:48:32 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-29 18:48:32 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK31693%27 HTTP/1.1" 200 None
2026-03-29 18:48:32 [auto1.de] INFO: Scrape type for WK31693: 2
2026-03-29 18:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-03-29 18:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f47b5984-7d4f-554a-b492-9773e9944a4c with scrape type 2
2026-03-29 18:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f47b5984-7d4f-554a-b492-9773e9944a4c with scrape type 2
2026-03-29 18:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f47b5984-7d4f-554a-b492-9773e9944a4c, identifier: WK31693
2026-03-29 18:48:33 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-03-29 18:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693
2026-03-29 18:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f47b5984-7d4f-554a-b492-9773e9944a4c with identifier: WK31693 to the API
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:57:19Z',
'fuel_type': 'petrol',
'id': 'f47b5984-7d4f-554a-b492-9773e9944a4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK31693',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 108785,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-28',
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost Trend',
'transmission': 'automatic',
'trim': 'Trend',
'year': 2015}
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK31693%27 HTTP/1.1" 200 None
2026-03-29 18:48:33 [auto1.de] INFO: Saving data for WK31693: {'auction_closing_time': 1774886239.0, 'created_time': 1774723648.902649, 'last_price_update_time': 1774810113.349651}
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK31693') HTTP/1.1" 204 0
2026-03-29 18:48:33 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL69602%27 HTTP/1.1" 200 None
2026-03-29 18:48:33 [auto1.de] INFO: Scrape type for WL69602: 2
2026-03-29 18:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602
2026-03-29 18:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with scrape type 2
2026-03-29 18:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with scrape type 2
2026-03-29 18:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 504fa8b7-c57e-55aa-862c-88e1f16bbad3, identifier: WL69602
2026-03-29 18:48:33 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA62575%27 HTTP/1.1" 200 None
2026-03-29 18:48:33 [auto1.de] INFO: Scrape type for HA62575: 2
2026-03-29 18:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575
2026-03-29 18:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7faebd26-33b6-5cd5-847d-8446a68f2db1 with scrape type 2
2026-03-29 18:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7faebd26-33b6-5cd5-847d-8446a68f2db1 with scrape type 2
2026-03-29 18:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7faebd26-33b6-5cd5-847d-8446a68f2db1, identifier: HA62575
2026-03-29 18:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602
2026-03-29 18:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602
2026-03-29 18:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 504fa8b7-c57e-55aa-862c-88e1f16bbad3 with identifier: WL69602 to the API
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:20Z',
'fuel_type': 'petrol',
'id': '504fa8b7-c57e-55aa-862c-88e1f16bbad3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL69602',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 73972,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-19',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT IQ.DRIVE',
'transmission': 'automatic',
'trim': 'IQ.DRIVE',
'year': 2019}
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL69602%27 HTTP/1.1" 200 None
2026-03-29 18:48:33 [auto1.de] INFO: Saving data for WL69602: {'auction_closing_time': 1774885940.0, 'created_time': 1774032556.7934, 'last_price_update_time': 1774810113.868522}
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL69602') HTTP/1.1" 204 0
2026-03-29 18:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575
2026-03-29 18:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575
2026-03-29 18:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7faebd26-33b6-5cd5-847d-8446a68f2db1 with identifier: HA62575 to the API
2026-03-29 18:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:53:31Z',
'fuel_type': 'petrol',
'id': '7faebd26-33b6-5cd5-847d-8446a68f2db1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA62575',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 131472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-19',
'seller_name': None,
'title': 'Peugeot 2008 1.2 e-VTi Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA62575%27 HTTP/1.1" 200 None
2026-03-29 18:48:34 [auto1.de] INFO: Saving data for HA62575: {'auction_closing_time': 1774886011.0, 'created_time': 1774723426.502455, 'last_price_update_time': 1774810114.165414}
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA62575') HTTP/1.1" 204 0
2026-03-29 18:48:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-29 18:48:34 [auto1.de] INFO: Scrape type for XU03488: 2
2026-03-29 18:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488
2026-03-29 18:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0027cc0c-a14c-52c7-b420-9eaff336f926 with scrape type 2
2026-03-29 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0027cc0c-a14c-52c7-b420-9eaff336f926 with scrape type 2
2026-03-29 18:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0027cc0c-a14c-52c7-b420-9eaff336f926, identifier: XU03488
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL96080%27 HTTP/1.1" 200 None
2026-03-29 18:48:34 [auto1.de] INFO: Scrape type for EL96080: 0
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-29 18:48:34 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS29172%27 HTTP/1.1" 200 None
2026-03-29 18:48:34 [auto1.de] INFO: Scrape type for DS29172: 2
2026-03-29 18:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172
2026-03-29 18:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with scrape type 2
2026-03-29 18:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with scrape type 2
2026-03-29 18:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5, identifier: DS29172
2026-03-29 18:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488
2026-03-29 18:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488
2026-03-29 18:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0027cc0c-a14c-52c7-b420-9eaff336f926 with identifier: XU03488 to the API
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:09:38Z',
'fuel_type': 'petrol',
'id': '0027cc0c-a14c-52c7-b420-9eaff336f926',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU03488',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 69321,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-24',
'seller_name': None,
'title': 'Volkswagen Caddy 1.2 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2016}
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-29 18:48:34 [auto1.de] INFO: Saving data for XU03488: {'auction_closing_time': 1774883378.0, 'created_time': 1774723451.377776, 'last_price_update_time': 1774810114.725326}
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU03488') HTTP/1.1" 204 0
2026-03-29 18:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172
2026-03-29 18:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172
2026-03-29 18:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5 with identifier: DS29172 to the API
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:08:11Z',
'fuel_type': 'diesel',
'id': '6f7cabf0-b0d4-5b7b-840e-ce9b8326bdd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS29172',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 79215,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-29',
'seller_name': None,
'title': 'Ford Transit 2.2 TDCi 300 L2 Tourneo Titanium',
'transmission': 'manual',
'trim': '300 L2 Tourneo Titanium',
'year': 2015}
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS29172%27 HTTP/1.1" 200 None
2026-03-29 18:48:35 [auto1.de] INFO: Saving data for DS29172: {'auction_closing_time': 1774883291.0, 'created_time': 1774723430.148292, 'last_price_update_time': 1774810115.101403}
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS29172') HTTP/1.1" 204 0
2026-03-29 18:48:35 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-29 18:48:35 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT96582%27 HTTP/1.1" 200 None
2026-03-29 18:48:35 [auto1.de] INFO: Scrape type for CT96582: 2
2026-03-29 18:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582
2026-03-29 18:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c4e953-abb0-5306-8d55-d68a1fa3b745 with scrape type 2
2026-03-29 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89c4e953-abb0-5306-8d55-d68a1fa3b745 with scrape type 2
2026-03-29 18:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89c4e953-abb0-5306-8d55-d68a1fa3b745, identifier: CT96582
2026-03-29 18:48:35 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE31393%27 HTTP/1.1" 200 None
2026-03-29 18:48:35 [auto1.de] INFO: Scrape type for WE31393: 2
2026-03-29 18:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393
2026-03-29 18:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f47c76-908f-53af-91a9-e878fa2bb1d2 with scrape type 2
2026-03-29 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3f47c76-908f-53af-91a9-e878fa2bb1d2 with scrape type 2
2026-03-29 18:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3f47c76-908f-53af-91a9-e878fa2bb1d2, identifier: WE31393
2026-03-29 18:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582
2026-03-29 18:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582
2026-03-29 18:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89c4e953-abb0-5306-8d55-d68a1fa3b745 with identifier: CT96582 to the API
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:38:08Z',
'fuel_type': 'petrol',
'id': '89c4e953-abb0-5306-8d55-d68a1fa3b745',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT96582',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 162372,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-06-19',
'seller_name': None,
'title': 'Suzuki Swift 1.2 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2011}
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT96582%27 HTTP/1.1" 200 None
2026-03-29 18:48:35 [auto1.de] INFO: Saving data for CT96582: {'auction_closing_time': 1774885088.0, 'created_time': 1774723435.569645, 'last_price_update_time': 1774810115.596806}
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT96582') HTTP/1.1" 204 0
2026-03-29 18:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393
2026-03-29 18:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393
2026-03-29 18:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3f47c76-908f-53af-91a9-e878fa2bb1d2 with identifier: WE31393 to the API
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:06:26Z',
'fuel_type': 'diesel',
'id': 'f3f47c76-908f-53af-91a9-e878fa2bb1d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE31393',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 323201,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-30',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE31393%27 HTTP/1.1" 200 None
2026-03-29 18:48:35 [auto1.de] INFO: Saving data for WE31393: {'auction_closing_time': 1774883186.0, 'created_time': 1774723425.658101, 'last_price_update_time': 1774810115.908268}
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE31393') HTTP/1.1" 204 0
2026-03-29 18:48:35 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-29 18:48:35 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK71515%27 HTTP/1.1" 200 None
2026-03-29 18:48:35 [auto1.de] INFO: Scrape type for EK71515: 2
2026-03-29 18:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515
2026-03-29 18:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with scrape type 2
2026-03-29 18:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with scrape type 2
2026-03-29 18:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3dbd7c2-b0ec-536c-84ea-1481aae7c765, identifier: EK71515
2026-03-29 18:48:36 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC29120%27 HTTP/1.1" 200 None
2026-03-29 18:48:36 [auto1.de] INFO: Scrape type for CC29120: 2
2026-03-29 18:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120
2026-03-29 18:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4695c50-6ea7-5d17-8c10-a32e8b470c24 with scrape type 2
2026-03-29 18:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4695c50-6ea7-5d17-8c10-a32e8b470c24 with scrape type 2
2026-03-29 18:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4695c50-6ea7-5d17-8c10-a32e8b470c24, identifier: CC29120
2026-03-29 18:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515
2026-03-29 18:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515
2026-03-29 18:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3dbd7c2-b0ec-536c-84ea-1481aae7c765 with identifier: EK71515 to the API
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:21:41Z',
'fuel_type': 'diesel',
'id': 'e3dbd7c2-b0ec-536c-84ea-1481aae7c765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK71515',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 385718,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-01',
'seller_name': None,
'title': 'Audi A6 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK71515%27 HTTP/1.1" 200 None
2026-03-29 18:48:36 [auto1.de] INFO: Saving data for EK71515: {'auction_closing_time': 1774884101.0, 'created_time': 1773381885.697415, 'last_price_update_time': 1774810116.440322}
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK71515') HTTP/1.1" 204 0
2026-03-29 18:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120
2026-03-29 18:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120
2026-03-29 18:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4695c50-6ea7-5d17-8c10-a32e8b470c24 with identifier: CC29120 to the API
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:00:17Z',
'fuel_type': 'petrol',
'id': 'a4695c50-6ea7-5d17-8c10-a32e8b470c24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC29120',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 55894,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-26',
'seller_name': None,
'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
'transmission': 'automatic',
'trim': 'sport',
'year': 2019}
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC29120%27 HTTP/1.1" 200 None
2026-03-29 18:48:36 [auto1.de] INFO: Saving data for CC29120: {'auction_closing_time': 1774882817.0, 'created_time': 1774723413.510462, 'last_price_update_time': 1774810116.722258}
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC29120') HTTP/1.1" 204 0
2026-03-29 18:48:36 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-29 18:48:36 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-29 18:48:36 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-29 18:48:36 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK31829%27 HTTP/1.1" 200 None
2026-03-29 18:48:36 [auto1.de] INFO: Scrape type for HK31829: 2
2026-03-29 18:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829
2026-03-29 18:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f58f49-a037-58ba-8a87-c7b75c1818d6 with scrape type 2
2026-03-29 18:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1f58f49-a037-58ba-8a87-c7b75c1818d6 with scrape type 2
2026-03-29 18:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1f58f49-a037-58ba-8a87-c7b75c1818d6, identifier: HK31829
2026-03-29 18:48:36 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT90380%27 HTTP/1.1" 200 None
2026-03-29 18:48:36 [auto1.de] INFO: Scrape type for FT90380: 2
2026-03-29 18:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380
2026-03-29 18:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e7d2f42-760d-5aa5-ac65-062955d47841 with scrape type 2
2026-03-29 18:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e7d2f42-760d-5aa5-ac65-062955d47841 with scrape type 2
2026-03-29 18:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e7d2f42-760d-5aa5-ac65-062955d47841, identifier: FT90380
2026-03-29 18:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829
2026-03-29 18:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829
2026-03-29 18:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1f58f49-a037-58ba-8a87-c7b75c1818d6 with identifier: HK31829 to the API
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:14:31Z',
'fuel_type': 'diesel',
'id': 'd1f58f49-a037-58ba-8a87-c7b75c1818d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK31829',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 220923,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-27',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI RS',
'transmission': 'manual',
'trim': 'RS',
'year': 2011}
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK31829%27 HTTP/1.1" 200 None
2026-03-29 18:48:37 [auto1.de] INFO: Saving data for HK31829: {'auction_closing_time': 1774883671.0, 'created_time': 1774350302.698907, 'last_price_update_time': 1774810117.24294}
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK31829') HTTP/1.1" 204 0
2026-03-29 18:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380
2026-03-29 18:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380
2026-03-29 18:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e7d2f42-760d-5aa5-ac65-062955d47841 with identifier: FT90380 to the API
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:46:13Z',
'fuel_type': 'petrol',
'id': '9e7d2f42-760d-5aa5-ac65-062955d47841',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT90380',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 86547,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2019}
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT90380%27 HTTP/1.1" 200 None
2026-03-29 18:48:37 [auto1.de] INFO: Saving data for FT90380: {'auction_closing_time': 1774885573.0, 'created_time': 1774723438.653174, 'last_price_update_time': 1774810117.618589}
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT90380') HTTP/1.1" 204 0
2026-03-29 18:48:37 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-29 18:48:37 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD40949%27 HTTP/1.1" 200 None
2026-03-29 18:48:37 [auto1.de] INFO: Scrape type for XD40949: 2
2026-03-29 18:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949
2026-03-29 18:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b35c26-8b63-5a37-9c29-939b9ef43fba with scrape type 2
2026-03-29 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2b35c26-8b63-5a37-9c29-939b9ef43fba with scrape type 2
2026-03-29 18:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2b35c26-8b63-5a37-9c29-939b9ef43fba, identifier: XD40949
2026-03-29 18:48:37 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA04539%27 HTTP/1.1" 200 None
2026-03-29 18:48:37 [auto1.de] INFO: Scrape type for SA04539: 2
2026-03-29 18:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539
2026-03-29 18:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50008ba-2bbe-5e83-b847-50ec08d70ddb with scrape type 2
2026-03-29 18:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e50008ba-2bbe-5e83-b847-50ec08d70ddb with scrape type 2
2026-03-29 18:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e50008ba-2bbe-5e83-b847-50ec08d70ddb, identifier: SA04539
2026-03-29 18:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949
2026-03-29 18:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949
2026-03-29 18:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2b35c26-8b63-5a37-9c29-939b9ef43fba with identifier: XD40949 to the API
2026-03-29 18:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:04:30Z',
'fuel_type': 'petrol',
'id': 'b2b35c26-8b63-5a37-9c29-939b9ef43fba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD40949',
'listing': 'auction',
'make': 'Volvo',
'model': 'C70',
'odometer': 89015,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-04-03',
'seller_name': None,
'title': 'Volvo C70 2.0 T',
'transmission': 'automatic',
'trim': '',
'year': 2001}
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD40949%27 HTTP/1.1" 200 None
2026-03-29 18:48:38 [auto1.de] INFO: Saving data for XD40949: {'auction_closing_time': 1774883070.0, 'created_time': 1774723442.068429, 'last_price_update_time': 1774810118.172452}
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD40949') HTTP/1.1" 204 0
2026-03-29 18:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539
2026-03-29 18:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539
2026-03-29 18:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e50008ba-2bbe-5e83-b847-50ec08d70ddb with identifier: SA04539 to the API
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:40:09Z',
'fuel_type': 'petrol',
'id': 'e50008ba-2bbe-5e83-b847-50ec08d70ddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA04539',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 139614,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-10-15',
'seller_name': None,
'title': 'Toyota Avensis 2.0 Executive Liftback',
'transmission': 'manual',
'trim': 'Executive Liftback',
'year': 2003}
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA04539%27 HTTP/1.1" 200 None
2026-03-29 18:48:38 [auto1.de] INFO: Saving data for SA04539: {'auction_closing_time': 1774885209.0, 'created_time': 1773400806.793666, 'last_price_update_time': 1774810118.452095}
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA04539') HTTP/1.1" 204 0
2026-03-29 18:48:38 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-29 18:48:38 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-29 18:48:38 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV41751%27 HTTP/1.1" 200 None
2026-03-29 18:48:38 [auto1.de] INFO: Scrape type for TV41751: 0
2026-03-29 18:48:38 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-29 18:48:38 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE40935%27 HTTP/1.1" 200 None
2026-03-29 18:48:38 [auto1.de] INFO: Scrape type for TE40935: 2
2026-03-29 18:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-03-29 18:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with scrape type 2
2026-03-29 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with scrape type 2
2026-03-29 18:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a115b0a9-c4ff-5bd2-bd26-83062c79fc48, identifier: TE40935
2026-03-29 18:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-03-29 18:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935
2026-03-29 18:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a115b0a9-c4ff-5bd2-bd26-83062c79fc48 with identifier: TE40935 to the API
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:31:16Z',
'fuel_type': 'petrol',
'id': 'a115b0a9-c4ff-5bd2-bd26-83062c79fc48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE40935',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 99321,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-27',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE40935%27 HTTP/1.1" 200 None
2026-03-29 18:48:38 [auto1.de] INFO: Saving data for TE40935: {'auction_closing_time': 1774884676.0, 'created_time': 1774723414.914754, 'last_price_update_time': 1774810118.878614}
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE40935') HTTP/1.1" 204 0
2026-03-29 18:48:38 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY13468%27 HTTP/1.1" 200 None
2026-03-29 18:48:38 [auto1.de] INFO: Scrape type for GY13468: 2
2026-03-29 18:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468
2026-03-29 18:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with scrape type 2
2026-03-29 18:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with scrape type 2
2026-03-29 18:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7, identifier: GY13468
2026-03-29 18:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468
2026-03-29 18:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468
2026-03-29 18:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7 with identifier: GY13468 to the API
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:15:39Z',
'fuel_type': 'petrol',
'id': 'f4acf582-c6a5-5e79-8070-b1fa9b2fa6d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY13468',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 26044,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-08-29',
'seller_name': None,
'title': 'BMW 3er 330i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2024}
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY13468%27 HTTP/1.1" 200 None
2026-03-29 18:48:39 [auto1.de] INFO: Saving data for GY13468: {'auction_closing_time': 1774883739.0, 'created_time': 1773428798.078898, 'last_price_update_time': 1774810119.282793}
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY13468') HTTP/1.1" 204 0
2026-03-29 18:48:39 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-29 18:48:39 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-29 18:48:39 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM83626%27 HTTP/1.1" 200 None
2026-03-29 18:48:39 [auto1.de] INFO: Scrape type for GM83626: 2
2026-03-29 18:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626
2026-03-29 18:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05dd185d-c026-5546-b32d-833eab0bbe0d with scrape type 2
2026-03-29 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05dd185d-c026-5546-b32d-833eab0bbe0d with scrape type 2
2026-03-29 18:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05dd185d-c026-5546-b32d-833eab0bbe0d, identifier: GM83626
2026-03-29 18:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626
2026-03-29 18:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626
2026-03-29 18:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05dd185d-c026-5546-b32d-833eab0bbe0d with identifier: GM83626 to the API
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:57:33Z',
'fuel_type': 'diesel',
'id': '05dd185d-c026-5546-b32d-833eab0bbe0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM83626',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 44183,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-04',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium X',
'transmission': 'automatic',
'trim': '320 L1 Tourneo Titanium X',
'year': 2020}
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM83626%27 HTTP/1.1" 200 None
2026-03-29 18:48:39 [auto1.de] INFO: Saving data for GM83626: {'auction_closing_time': 1774886253.0, 'created_time': 1774350525.411405, 'last_price_update_time': 1774810119.700219}
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM83626') HTTP/1.1" 204 0
2026-03-29 18:48:39 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-29 18:48:39 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-29 18:48:39 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP47731%27 HTTP/1.1" 200 None
2026-03-29 18:48:39 [auto1.de] INFO: Scrape type for NP47731: 2
2026-03-29 18:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731
2026-03-29 18:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b161d4c-13d1-5cfc-8c38-102d072c9808 with scrape type 2
2026-03-29 18:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b161d4c-13d1-5cfc-8c38-102d072c9808 with scrape type 2
2026-03-29 18:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b161d4c-13d1-5cfc-8c38-102d072c9808, identifier: NP47731
2026-03-29 18:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731
2026-03-29 18:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731
2026-03-29 18:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b161d4c-13d1-5cfc-8c38-102d072c9808 with identifier: NP47731 to the API
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:52:09Z',
'fuel_type': 'petrol',
'id': '7b161d4c-13d1-5cfc-8c38-102d072c9808',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP47731',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 104455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-06',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2013}
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP47731%27 HTTP/1.1" 200 None
2026-03-29 18:48:40 [auto1.de] INFO: Saving data for NP47731: {'auction_closing_time': 1774885929.0, 'created_time': 1773340822.124049, 'last_price_update_time': 1774810120.192736}
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP47731') HTTP/1.1" 204 0
2026-03-29 18:48:40 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: JP17422
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86463%27 HTTP/1.1" 200 None
2026-03-29 18:48:40 [auto1.de] INFO: Scrape type for JJ86463: 2
2026-03-29 18:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463
2026-03-29 18:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with scrape type 2
2026-03-29 18:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with scrape type 2
2026-03-29 18:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 135d5cbc-1772-58d5-85c5-6a8f3789fa46, identifier: JJ86463
2026-03-29 18:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463
2026-03-29 18:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463
2026-03-29 18:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 135d5cbc-1772-58d5-85c5-6a8f3789fa46 with identifier: JJ86463 to the API
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:38:52Z',
'fuel_type': 'petrol',
'id': '135d5cbc-1772-58d5-85c5-6a8f3789fa46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ86463',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 310456,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1999-06-09',
'seller_name': None,
'title': 'BMW 3er 323i',
'transmission': 'manual',
'trim': '',
'year': 1999}
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86463%27 HTTP/1.1" 200 None
2026-03-29 18:48:40 [auto1.de] INFO: Saving data for JJ86463: {'auction_closing_time': 1774885132.0, 'created_time': 1774118742.569574, 'last_price_update_time': 1774810120.586098}
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ86463') HTTP/1.1" 204 0
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN03303%27 HTTP/1.1" 200 None
2026-03-29 18:48:40 [auto1.de] INFO: Scrape type for NN03303: 2
2026-03-29 18:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303
2026-03-29 18:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with scrape type 2
2026-03-29 18:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with scrape type 2
2026-03-29 18:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306, identifier: NN03303
2026-03-29 18:48:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-29 18:48:40 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB44378%27 HTTP/1.1" 200 None
2026-03-29 18:48:40 [auto1.de] INFO: Scrape type for UB44378: 2
2026-03-29 18:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378
2026-03-29 18:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631fc12c-c425-58b2-920f-935a9c081e00 with scrape type 2
2026-03-29 18:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 631fc12c-c425-58b2-920f-935a9c081e00 with scrape type 2
2026-03-29 18:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 631fc12c-c425-58b2-920f-935a9c081e00, identifier: UB44378
2026-03-29 18:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303
2026-03-29 18:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303
2026-03-29 18:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306 with identifier: NN03303 to the API
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:20:15Z',
'fuel_type': 'petrol',
'id': 'ddb5bcaa-5ab7-58e7-8686-99a9ec9fc306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN03303',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 156631,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-11-29',
'seller_name': None,
'title': 'BMW 3er 320Ci',
'transmission': 'automatic',
'trim': '',
'year': 2000}
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN03303%27 HTTP/1.1" 200 None
2026-03-29 18:48:41 [auto1.de] INFO: Saving data for NN03303: {'auction_closing_time': 1774884015.0, 'created_time': 1774723449.12, 'last_price_update_time': 1774810121.091857}
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN03303') HTTP/1.1" 204 0
2026-03-29 18:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378
2026-03-29 18:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378
2026-03-29 18:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 631fc12c-c425-58b2-920f-935a9c081e00 with identifier: UB44378 to the API
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:38Z',
'fuel_type': 'petrol',
'id': '631fc12c-c425-58b2-920f-935a9c081e00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB44378',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 120930,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-25',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Clever',
'transmission': 'automatic',
'trim': 'Clever',
'year': 2019}
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB44378%27 HTTP/1.1" 200 None
2026-03-29 18:48:41 [auto1.de] INFO: Saving data for UB44378: {'auction_closing_time': 1774884638.0, 'created_time': 1774723440.75138, 'last_price_update_time': 1774810121.473258}
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB44378') HTTP/1.1" 204 0
2026-03-29 18:48:41 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-29 18:48:41 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43778%27 HTTP/1.1" 200 None
2026-03-29 18:48:41 [auto1.de] INFO: Scrape type for LB43778: 2
2026-03-29 18:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778
2026-03-29 18:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a85423-5686-5bb9-840e-6941a61afb95 with scrape type 2
2026-03-29 18:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7a85423-5686-5bb9-840e-6941a61afb95 with scrape type 2
2026-03-29 18:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7a85423-5686-5bb9-840e-6941a61afb95, identifier: LB43778
2026-03-29 18:48:41 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE18724%27 HTTP/1.1" 200 None
2026-03-29 18:48:41 [auto1.de] INFO: Scrape type for CE18724: 2
2026-03-29 18:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724
2026-03-29 18:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fe489be-7fe9-5633-b607-60dc43c9a581 with scrape type 2
2026-03-29 18:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fe489be-7fe9-5633-b607-60dc43c9a581 with scrape type 2
2026-03-29 18:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fe489be-7fe9-5633-b607-60dc43c9a581, identifier: CE18724
2026-03-29 18:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778
2026-03-29 18:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778
2026-03-29 18:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7a85423-5686-5bb9-840e-6941a61afb95 with identifier: LB43778 to the API
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:02:39Z',
'fuel_type': 'petrol',
'id': 'a7a85423-5686-5bb9-840e-6941a61afb95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB43778',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 212667,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-16',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43778%27 HTTP/1.1" 200 None
2026-03-29 18:48:41 [auto1.de] INFO: Saving data for LB43778: {'auction_closing_time': 1774882959.0, 'created_time': 1774723458.205091, 'last_price_update_time': 1774810121.978273}
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB43778') HTTP/1.1" 204 0
2026-03-29 18:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724
2026-03-29 18:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724
2026-03-29 18:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fe489be-7fe9-5633-b607-60dc43c9a581 with identifier: CE18724 to the API
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:11:40Z',
'fuel_type': 'petrol',
'id': '0fe489be-7fe9-5633-b607-60dc43c9a581',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE18724',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 273945,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-03',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2016}
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE18724%27 HTTP/1.1" 200 None
2026-03-29 18:48:42 [auto1.de] INFO: Saving data for CE18724: {'auction_closing_time': 1774883500.0, 'created_time': 1774034547.014284, 'last_price_update_time': 1774810122.282495}
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE18724') HTTP/1.1" 204 0
2026-03-29 18:48:42 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-29 18:48:42 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC86157%27 HTTP/1.1" 200 None
2026-03-29 18:48:42 [auto1.de] INFO: Scrape type for HC86157: 2
2026-03-29 18:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157
2026-03-29 18:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with scrape type 2
2026-03-29 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with scrape type 2
2026-03-29 18:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae, identifier: HC86157
2026-03-29 18:48:42 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98696%27 HTTP/1.1" 200 None
2026-03-29 18:48:42 [auto1.de] INFO: Scrape type for WN98696: 2
2026-03-29 18:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696
2026-03-29 18:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db18e522-6670-54d3-a7d1-0ace20592ac6 with scrape type 2
2026-03-29 18:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db18e522-6670-54d3-a7d1-0ace20592ac6 with scrape type 2
2026-03-29 18:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db18e522-6670-54d3-a7d1-0ace20592ac6, identifier: WN98696
2026-03-29 18:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157
2026-03-29 18:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157
2026-03-29 18:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 725b5dc1-d3b4-51b8-8462-8a4cf65528ae with identifier: HC86157 to the API
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:56:25Z',
'fuel_type': 'petrol',
'id': '725b5dc1-d3b4-51b8-8462-8a4cf65528ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC86157',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 222371,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Renault Megane 1.4 TCe Night & Day',
'transmission': 'manual',
'trim': 'Night & Day',
'year': 2010}
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC86157%27 HTTP/1.1" 200 None
2026-03-29 18:48:42 [auto1.de] INFO: Saving data for HC86157: {'auction_closing_time': 1774886185.0, 'created_time': 1774350048.537724, 'last_price_update_time': 1774810122.773188}
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC86157') HTTP/1.1" 204 0
2026-03-29 18:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696
2026-03-29 18:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696
2026-03-29 18:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db18e522-6670-54d3-a7d1-0ace20592ac6 with identifier: WN98696 to the API
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:50:13Z',
'fuel_type': 'petrol',
'id': 'db18e522-6670-54d3-a7d1-0ace20592ac6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN98696',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 215879,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-26',
'seller_name': None,
'title': 'Seat Leon 1.2 TSI I-Tech',
'transmission': 'manual',
'trim': 'I-Tech',
'year': 2015}
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98696%27 HTTP/1.1" 200 None
2026-03-29 18:48:43 [auto1.de] INFO: Saving data for WN98696: {'auction_closing_time': 1774885813.0, 'created_time': 1774723439.027951, 'last_price_update_time': 1774810123.069374}
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN98696') HTTP/1.1" 204 0
2026-03-29 18:48:43 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-29 18:48:43 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-29 18:48:43 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-29 18:48:43 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM32674%27 HTTP/1.1" 200 None
2026-03-29 18:48:43 [auto1.de] INFO: Scrape type for TM32674: 2
2026-03-29 18:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674
2026-03-29 18:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with scrape type 2
2026-03-29 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with scrape type 2
2026-03-29 18:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef1c5a0f-867a-5769-8467-ae2e2a4e0487, identifier: TM32674
2026-03-29 18:48:43 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-29 18:48:43 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-29 18:48:43 [auto1.de] INFO: Scrape type for YD40390: 2
2026-03-29 18:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390
2026-03-29 18:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with scrape type 2
2026-03-29 18:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with scrape type 2
2026-03-29 18:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b, identifier: YD40390
2026-03-29 18:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674
2026-03-29 18:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674
2026-03-29 18:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef1c5a0f-867a-5769-8467-ae2e2a4e0487 with identifier: TM32674 to the API
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 240,
'expiration_date': '2026-03-30T15:31:45Z',
'fuel_type': 'petrol',
'id': 'ef1c5a0f-867a-5769-8467-ae2e2a4e0487',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM32674',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 45050,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-08',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Turbo HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2018}
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM32674%27 HTTP/1.1" 200 None
2026-03-29 18:48:43 [auto1.de] INFO: Saving data for TM32674: {'auction_closing_time': 1774884705.0, 'created_time': 1774723455.571746, 'last_price_update_time': 1774810123.602194}
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM32674') HTTP/1.1" 204 0
2026-03-29 18:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390
2026-03-29 18:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390
2026-03-29 18:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b8d421e-03a1-53cc-8ef0-70adfdc2b25b with identifier: YD40390 to the API
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:12:27Z',
'fuel_type': 'petrol',
'id': '0b8d421e-03a1-53cc-8ef0-70adfdc2b25b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD40390',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 121059,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-13',
'seller_name': None,
'title': 'Fiat Punto 1.2 More',
'transmission': 'manual',
'trim': 'More',
'year': 2012}
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-29 18:48:43 [auto1.de] INFO: Saving data for YD40390: {'auction_closing_time': 1774883547.0, 'created_time': 1774723430.791673, 'last_price_update_time': 1774810123.991267}
2026-03-29 18:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD40390') HTTP/1.1" 204 0
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ75381%27 HTTP/1.1" 200 None
2026-03-29 18:48:44 [auto1.de] INFO: Scrape type for AJ75381: 2
2026-03-29 18:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381
2026-03-29 18:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d39891a9-ab3c-550b-8826-bff0c4e91ba8 with scrape type 2
2026-03-29 18:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d39891a9-ab3c-550b-8826-bff0c4e91ba8 with scrape type 2
2026-03-29 18:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d39891a9-ab3c-550b-8826-bff0c4e91ba8, identifier: AJ75381
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11888%27 HTTP/1.1" 200 None
2026-03-29 18:48:44 [auto1.de] INFO: Scrape type for AJ11888: 2
2026-03-29 18:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888
2026-03-29 18:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61869c94-284d-5da7-844d-223e3a8b1c3f with scrape type 2
2026-03-29 18:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61869c94-284d-5da7-844d-223e3a8b1c3f with scrape type 2
2026-03-29 18:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61869c94-284d-5da7-844d-223e3a8b1c3f, identifier: AJ11888
2026-03-29 18:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381
2026-03-29 18:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381
2026-03-29 18:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d39891a9-ab3c-550b-8826-bff0c4e91ba8 with identifier: AJ75381 to the API
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:59:57Z',
'fuel_type': 'petrol',
'id': 'd39891a9-ab3c-550b-8826-bff0c4e91ba8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ75381',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 73422,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-17',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2015}
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ75381%27 HTTP/1.1" 200 None
2026-03-29 18:48:44 [auto1.de] INFO: Saving data for AJ75381: {'auction_closing_time': 1774886397.0, 'created_time': 1774350453.075734, 'last_price_update_time': 1774810124.503966}
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ75381') HTTP/1.1" 204 0
2026-03-29 18:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888
2026-03-29 18:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888
2026-03-29 18:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61869c94-284d-5da7-844d-223e3a8b1c3f with identifier: AJ11888 to the API
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:07:07Z',
'fuel_type': 'petrol',
'id': '61869c94-284d-5da7-844d-223e3a8b1c3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ11888',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Colt',
'odometer': 56865,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-30',
'seller_name': None,
'title': 'Mitsubishi Colt 1.1 ClearTec 35 Jahre',
'transmission': 'manual',
'trim': 'ClearTec 35 Jahre',
'year': 2012}
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11888%27 HTTP/1.1" 200 None
2026-03-29 18:48:44 [auto1.de] INFO: Saving data for AJ11888: {'auction_closing_time': 1774883227.0, 'created_time': 1774723454.73322, 'last_price_update_time': 1774810124.790314}
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ11888') HTTP/1.1" 204 0
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-29 18:48:44 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG76993%27 HTTP/1.1" 200 None
2026-03-29 18:48:44 [auto1.de] INFO: Scrape type for SG76993: 2
2026-03-29 18:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993
2026-03-29 18:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with scrape type 2
2026-03-29 18:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with scrape type 2
2026-03-29 18:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64, identifier: SG76993
2026-03-29 18:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993
2026-03-29 18:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993
2026-03-29 18:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64 with identifier: SG76993 to the API
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:01Z',
'fuel_type': 'diesel',
'id': '55e84a03-5c78-5bd1-b5bc-8fdd2ab25e64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG76993',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 82086,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-19',
'seller_name': None,
'title': 'BMW 2er 218d Sport Line',
'transmission': 'automatic',
'trim': 'Sport Line',
'year': 2018}
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG76993%27 HTTP/1.1" 200 None
2026-03-29 18:48:45 [auto1.de] INFO: Saving data for SG76993: {'auction_closing_time': 1774885561.0, 'created_time': 1774723421.921905, 'last_price_update_time': 1774810125.190241}
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG76993') HTTP/1.1" 204 0
2026-03-29 18:48:45 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95933%27 HTTP/1.1" 200 None
2026-03-29 18:48:45 [auto1.de] INFO: Scrape type for EY95933: 2
2026-03-29 18:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933
2026-03-29 18:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a08758-cbb6-5aac-a44a-d689a1b324dc with scrape type 2
2026-03-29 18:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a08758-cbb6-5aac-a44a-d689a1b324dc with scrape type 2
2026-03-29 18:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a08758-cbb6-5aac-a44a-d689a1b324dc, identifier: EY95933
2026-03-29 18:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933
2026-03-29 18:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933
2026-03-29 18:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a08758-cbb6-5aac-a44a-d689a1b324dc with identifier: EY95933 to the API
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:10Z',
'fuel_type': 'diesel',
'id': '29a08758-cbb6-5aac-a44a-d689a1b324dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY95933',
'listing': 'auction',
'make': 'Hyundai',
'model': 'H1',
'odometer': 139208,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-13',
'seller_name': None,
'title': 'Hyundai H1 2.5 CRDi Travel Trend',
'transmission': 'manual',
'trim': 'Travel Trend',
'year': 2017}
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95933%27 HTTP/1.1" 200 None
2026-03-29 18:48:45 [auto1.de] INFO: Saving data for EY95933: {'auction_closing_time': 1774883890.0, 'created_time': 1774032239.018308, 'last_price_update_time': 1774810125.685616}
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY95933') HTTP/1.1" 204 0
2026-03-29 18:48:45 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30537%27 HTTP/1.1" 200 None
2026-03-29 18:48:45 [auto1.de] INFO: Scrape type for KR30537: 2
2026-03-29 18:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537
2026-03-29 18:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d38535-6d09-556e-86fc-f9baa396f460 with scrape type 2
2026-03-29 18:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d38535-6d09-556e-86fc-f9baa396f460 with scrape type 2
2026-03-29 18:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41d38535-6d09-556e-86fc-f9baa396f460, identifier: KR30537
2026-03-29 18:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537
2026-03-29 18:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537
2026-03-29 18:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41d38535-6d09-556e-86fc-f9baa396f460 with identifier: KR30537 to the API
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:21:11Z',
'fuel_type': 'petrol',
'id': '41d38535-6d09-556e-86fc-f9baa396f460',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR30537',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 71772,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-01',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2018}
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30537%27 HTTP/1.1" 200 None
2026-03-29 18:48:46 [auto1.de] INFO: Saving data for KR30537: {'auction_closing_time': 1774884071.0, 'created_time': 1774089326.775551, 'last_price_update_time': 1774810126.116137}
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR30537') HTTP/1.1" 204 0
2026-03-29 18:48:46 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-29 18:48:46 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY00372%27 HTTP/1.1" 200 None
2026-03-29 18:48:46 [auto1.de] INFO: Scrape type for JY00372: 2
2026-03-29 18:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372
2026-03-29 18:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f170e5e9-1e83-5c24-924a-e38ce729509b with scrape type 2
2026-03-29 18:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f170e5e9-1e83-5c24-924a-e38ce729509b with scrape type 2
2026-03-29 18:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f170e5e9-1e83-5c24-924a-e38ce729509b, identifier: JY00372
2026-03-29 18:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372
2026-03-29 18:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372
2026-03-29 18:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f170e5e9-1e83-5c24-924a-e38ce729509b with identifier: JY00372 to the API
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:11:31Z',
'fuel_type': 'petrol',
'id': 'f170e5e9-1e83-5c24-924a-e38ce729509b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY00372',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 140677,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-31',
'seller_name': None,
'title': 'Volkswagen Caddy 1.4 Life Gewinner Caddy',
'transmission': 'manual',
'trim': 'Life Gewinner',
'year': 2009}
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY00372%27 HTTP/1.1" 200 None
2026-03-29 18:48:46 [auto1.de] INFO: Saving data for JY00372: {'auction_closing_time': 1774883491.0, 'created_time': 1774723417.527997, 'last_price_update_time': 1774810126.511487}
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY00372') HTTP/1.1" 204 0
2026-03-29 18:48:46 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-29 18:48:46 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-29 18:48:46 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP09693%27 HTTP/1.1" 200 None
2026-03-29 18:48:46 [auto1.de] INFO: Scrape type for BP09693: 2
2026-03-29 18:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693
2026-03-29 18:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c80d6-fe88-52f8-9955-fff8e5f4610f with scrape type 2
2026-03-29 18:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606c80d6-fe88-52f8-9955-fff8e5f4610f with scrape type 2
2026-03-29 18:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 606c80d6-fe88-52f8-9955-fff8e5f4610f, identifier: BP09693
2026-03-29 18:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693
2026-03-29 18:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693
2026-03-29 18:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 606c80d6-fe88-52f8-9955-fff8e5f4610f with identifier: BP09693 to the API
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 326,
'expiration_date': '2026-03-30T15:01:40Z',
'fuel_type': 'diesel',
'id': '606c80d6-fe88-52f8-9955-fff8e5f4610f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP09693',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 78711,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-06',
'seller_name': None,
'title': 'BMW X3 M40d',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP09693%27 HTTP/1.1" 200 None
2026-03-29 18:48:46 [auto1.de] INFO: Saving data for BP09693: {'auction_closing_time': 1774882900.0, 'created_time': 1774350645.065251, 'last_price_update_time': 1774810126.891794}
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP09693') HTTP/1.1" 204 0
2026-03-29 18:48:46 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-29 18:48:46 [auto1.de] INFO: Scrape type for BT01554: 2
2026-03-29 18:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554
2026-03-29 18:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with scrape type 2
2026-03-29 18:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with scrape type 2
2026-03-29 18:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65484d54-8a63-5ef0-9ec8-7299f1a362a1, identifier: BT01554
2026-03-29 18:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554
2026-03-29 18:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554
2026-03-29 18:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65484d54-8a63-5ef0-9ec8-7299f1a362a1 with identifier: BT01554 to the API
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:09Z',
'fuel_type': 'diesel',
'id': '65484d54-8a63-5ef0-9ec8-7299f1a362a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT01554',
'listing': 'auction',
'make': 'Fiat',
'model': 'Qubo',
'odometer': 148818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-27',
'seller_name': None,
'title': 'Fiat Qubo 1.3 JTD Trekking',
'transmission': 'manual',
'trim': 'Trekking',
'year': 2010}
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-29 18:48:47 [auto1.de] INFO: Saving data for BT01554: {'auction_closing_time': 1774884849.0, 'created_time': 1774723441.147408, 'last_price_update_time': 1774810127.285387}
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT01554') HTTP/1.1" 204 0
2026-03-29 18:48:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:47 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-29 18:48:47 [auto1.de] INFO: Scrape type for MG61327: 2
2026-03-29 18:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327
2026-03-29 18:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce586af7-0907-5a55-87b6-814dde2b01e0 with scrape type 2
2026-03-29 18:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce586af7-0907-5a55-87b6-814dde2b01e0 with scrape type 2
2026-03-29 18:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce586af7-0907-5a55-87b6-814dde2b01e0, identifier: MG61327
2026-03-29 18:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327
2026-03-29 18:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327
2026-03-29 18:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce586af7-0907-5a55-87b6-814dde2b01e0 with identifier: MG61327 to the API
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:36:55Z',
'fuel_type': 'petrol',
'id': 'ce586af7-0907-5a55-87b6-814dde2b01e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG61327',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 192797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-09',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-29 18:48:47 [auto1.de] INFO: Saving data for MG61327: {'auction_closing_time': 1774885015.0, 'created_time': 1773381348.983208, 'last_price_update_time': 1774810127.689971}
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG61327') HTTP/1.1" 204 0
2026-03-29 18:48:47 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM00053%27 HTTP/1.1" 200 None
2026-03-29 18:48:47 [auto1.de] INFO: Scrape type for BM00053: 2
2026-03-29 18:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053
2026-03-29 18:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a62c19-099e-5cb3-9054-47fb26baf592 with scrape type 2
2026-03-29 18:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a62c19-099e-5cb3-9054-47fb26baf592 with scrape type 2
2026-03-29 18:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a62c19-099e-5cb3-9054-47fb26baf592, identifier: BM00053
2026-03-29 18:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053
2026-03-29 18:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053
2026-03-29 18:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a62c19-099e-5cb3-9054-47fb26baf592 with identifier: BM00053 to the API
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-30T15:54:16Z',
'fuel_type': 'diesel',
'id': 'd2a62c19-099e-5cb3-9054-47fb26baf592',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM00053',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 211206,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-29',
'seller_name': None,
'title': 'Renault Trafic 2.5 dCi Generation Evado',
'transmission': 'manual',
'trim': 'Generation Evado',
'year': 2009}
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM00053%27 HTTP/1.1" 200 None
2026-03-29 18:48:48 [auto1.de] INFO: Saving data for BM00053: {'auction_closing_time': 1774886056.0, 'created_time': 1774723415.229548, 'last_price_update_time': 1774810128.113003}
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM00053') HTTP/1.1" 204 0
2026-03-29 18:48:48 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:48 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK22023%27 HTTP/1.1" 200 None
2026-03-29 18:48:48 [auto1.de] INFO: Scrape type for MK22023: 2
2026-03-29 18:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023
2026-03-29 18:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with scrape type 2
2026-03-29 18:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with scrape type 2
2026-03-29 18:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e86676-a5b6-5fcb-80ea-59c9a73978e8, identifier: MK22023
2026-03-29 18:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023
2026-03-29 18:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023
2026-03-29 18:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e86676-a5b6-5fcb-80ea-59c9a73978e8 with identifier: MK22023 to the API
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:46:46Z',
'fuel_type': 'diesel',
'id': '55e86676-a5b6-5fcb-80ea-59c9a73978e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK22023',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 317803,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-23',
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK22023%27 HTTP/1.1" 200 None
2026-03-29 18:48:48 [auto1.de] INFO: Saving data for MK22023: {'auction_closing_time': 1774885606.0, 'created_time': 1774723429.172058, 'last_price_update_time': 1774810128.501455}
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK22023') HTTP/1.1" 204 0
2026-03-29 18:48:48 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR46217%27 HTTP/1.1" 200 None
2026-03-29 18:48:48 [auto1.de] INFO: Scrape type for VR46217: 2
2026-03-29 18:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217
2026-03-29 18:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69de0b48-50d4-5864-928a-348cc3786330 with scrape type 2
2026-03-29 18:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69de0b48-50d4-5864-928a-348cc3786330 with scrape type 2
2026-03-29 18:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69de0b48-50d4-5864-928a-348cc3786330, identifier: VR46217
2026-03-29 18:48:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:48 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-29 18:48:48 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG08845%27 HTTP/1.1" 200 None
2026-03-29 18:48:48 [auto1.de] INFO: Scrape type for BG08845: 2
2026-03-29 18:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845
2026-03-29 18:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e72222-5917-5acd-9ab3-a03f214418d3 with scrape type 2
2026-03-29 18:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e72222-5917-5acd-9ab3-a03f214418d3 with scrape type 2
2026-03-29 18:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46e72222-5917-5acd-9ab3-a03f214418d3, identifier: BG08845
2026-03-29 18:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217
2026-03-29 18:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217
2026-03-29 18:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69de0b48-50d4-5864-928a-348cc3786330 with identifier: VR46217 to the API
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-30T15:28:52Z',
'fuel_type': 'petrol',
'id': '69de0b48-50d4-5864-928a-348cc3786330',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR46217',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 81067,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-26',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
'transmission': 'automatic',
'trim': 'GTI TCR',
'year': 2019}
2026-03-29 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR46217%27 HTTP/1.1" 200 None
2026-03-29 18:48:49 [auto1.de] INFO: Saving data for VR46217: {'auction_closing_time': 1774884532.0, 'created_time': 1774723453.509149, 'last_price_update_time': 1774810129.10324}
2026-03-29 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR46217') HTTP/1.1" 204 0
2026-03-29 18:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845
2026-03-29 18:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845
2026-03-29 18:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46e72222-5917-5acd-9ab3-a03f214418d3 with identifier: BG08845 to the API
2026-03-29 18:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:27:50Z',
'fuel_type': 'petrol',
'id': '46e72222-5917-5acd-9ab3-a03f214418d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG08845',
'listing': 'auction',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 46113,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-01',
'seller_name': None,
'title': 'MINI Cabrio Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2010}
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG08845%27 HTTP/1.1" 200 None
2026-03-29 18:48:50 [auto1.de] INFO: Saving data for BG08845: {'auction_closing_time': 1774884470.0, 'created_time': 1773429540.842334, 'last_price_update_time': 1774810130.101329}
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG08845') HTTP/1.1" 204 0
2026-03-29 18:48:50 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH28612%27 HTTP/1.1" 200 None
2026-03-29 18:48:50 [auto1.de] INFO: Scrape type for XH28612: 2
2026-03-29 18:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612
2026-03-29 18:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915406a7-db45-5663-97f1-3654017a8211 with scrape type 2
2026-03-29 18:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915406a7-db45-5663-97f1-3654017a8211 with scrape type 2
2026-03-29 18:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 915406a7-db45-5663-97f1-3654017a8211, identifier: XH28612
2026-03-29 18:48:50 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR37501%27 HTTP/1.1" 200 None
2026-03-29 18:48:50 [auto1.de] INFO: Scrape type for TR37501: 2
2026-03-29 18:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501
2026-03-29 18:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with scrape type 2
2026-03-29 18:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with scrape type 2
2026-03-29 18:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc, identifier: TR37501
2026-03-29 18:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612
2026-03-29 18:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612
2026-03-29 18:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 915406a7-db45-5663-97f1-3654017a8211 with identifier: XH28612 to the API
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:29:45Z',
'fuel_type': 'petrol',
'id': '915406a7-db45-5663-97f1-3654017a8211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH28612',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 240037,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-11-08',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 4.4 V8 HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2005}
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH28612%27 HTTP/1.1" 200 None
2026-03-29 18:48:50 [auto1.de] INFO: Saving data for XH28612: {'auction_closing_time': 1774884585.0, 'created_time': 1774723462.804829, 'last_price_update_time': 1774810130.625587}
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH28612') HTTP/1.1" 204 0
2026-03-29 18:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501
2026-03-29 18:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501
2026-03-29 18:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9e1303d-5d7b-50ae-9ced-57a83b1ddbfc with identifier: TR37501 to the API
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:21:10Z',
'fuel_type': 'petrol',
'id': 'd9e1303d-5d7b-50ae-9ced-57a83b1ddbfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR37501',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 30023,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-22',
'seller_name': None,
'title': 'Hyundai Kona 1.0 TGDI Trend 2WD',
'transmission': 'manual',
'trim': 'Trend 2WD',
'year': 2019}
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR37501%27 HTTP/1.1" 200 None
2026-03-29 18:48:50 [auto1.de] INFO: Saving data for TR37501: {'auction_closing_time': 1774884070.0, 'created_time': 1774723445.909766, 'last_price_update_time': 1774810130.914612}
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR37501') HTTP/1.1" 204 0
2026-03-29 18:48:50 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ41571%27 HTTP/1.1" 200 None
2026-03-29 18:48:50 [auto1.de] INFO: Scrape type for KJ41571: 2
2026-03-29 18:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571
2026-03-29 18:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7722bd6c-f2c2-5e02-84b6-aa464062026e with scrape type 2
2026-03-29 18:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7722bd6c-f2c2-5e02-84b6-aa464062026e with scrape type 2
2026-03-29 18:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7722bd6c-f2c2-5e02-84b6-aa464062026e, identifier: KJ41571
2026-03-29 18:48:51 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL05357%27 HTTP/1.1" 200 None
2026-03-29 18:48:51 [auto1.de] INFO: Scrape type for UL05357: 2
2026-03-29 18:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357
2026-03-29 18:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9311a12-f9d7-56fd-9c25-3c04cb4a805e with scrape type 2
2026-03-29 18:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9311a12-f9d7-56fd-9c25-3c04cb4a805e with scrape type 2
2026-03-29 18:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9311a12-f9d7-56fd-9c25-3c04cb4a805e, identifier: UL05357
2026-03-29 18:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571
2026-03-29 18:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571
2026-03-29 18:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7722bd6c-f2c2-5e02-84b6-aa464062026e with identifier: KJ41571 to the API
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:35:46Z',
'fuel_type': 'diesel',
'id': '7722bd6c-f2c2-5e02-84b6-aa464062026e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ41571',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 236829,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-13',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi Business Edition',
'transmission': 'automatic',
'trim': 'Business Edition',
'year': 2013}
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ41571%27 HTTP/1.1" 200 None
2026-03-29 18:48:51 [auto1.de] INFO: Saving data for KJ41571: {'auction_closing_time': 1774884946.0, 'created_time': 1774723460.865846, 'last_price_update_time': 1774810131.447567}
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ41571') HTTP/1.1" 204 0
2026-03-29 18:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357
2026-03-29 18:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357
2026-03-29 18:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9311a12-f9d7-56fd-9c25-3c04cb4a805e with identifier: UL05357 to the API
2026-03-29 18:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:39:15Z',
'fuel_type': 'petrol',
'id': 'b9311a12-f9d7-56fd-9c25-3c04cb4a805e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL05357',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'SLK-Klasse',
'odometer': 149150,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-26',
'seller_name': None,
'title': 'Mercedes-Benz SLK-Klasse SLK 300',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL05357%27 HTTP/1.1" 200 None
2026-03-29 18:48:52 [auto1.de] INFO: Saving data for UL05357: {'auction_closing_time': 1774885155.0, 'created_time': 1774089519.344794, 'last_price_update_time': 1774810132.601184}
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL05357') HTTP/1.1" 204 0
2026-03-29 18:48:52 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD70348%27 HTTP/1.1" 200 None
2026-03-29 18:48:52 [auto1.de] INFO: Scrape type for UD70348: 2
2026-03-29 18:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348
2026-03-29 18:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with scrape type 2
2026-03-29 18:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with scrape type 2
2026-03-29 18:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5, identifier: UD70348
2026-03-29 18:48:52 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-29 18:48:52 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-29 18:48:52 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW29658%27 HTTP/1.1" 200 None
2026-03-29 18:48:52 [auto1.de] INFO: Scrape type for LW29658: 2
2026-03-29 18:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658
2026-03-29 18:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d752ec-7828-572b-a9c6-59aed5aa7758 with scrape type 2
2026-03-29 18:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9d752ec-7828-572b-a9c6-59aed5aa7758 with scrape type 2
2026-03-29 18:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9d752ec-7828-572b-a9c6-59aed5aa7758, identifier: LW29658
2026-03-29 18:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348
2026-03-29 18:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348
2026-03-29 18:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 300f2c25-04dd-5b54-ae27-95cf17d8ffb5 with identifier: UD70348 to the API
2026-03-29 18:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:48:05Z',
'fuel_type': 'diesel',
'id': '300f2c25-04dd-5b54-ae27-95cf17d8ffb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD70348',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 202777,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-02-17',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2004}
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD70348%27 HTTP/1.1" 200 None
2026-03-29 18:48:53 [auto1.de] INFO: Saving data for UD70348: {'auction_closing_time': 1774885685.0, 'created_time': 1773382620.844264, 'last_price_update_time': 1774810133.119209}
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD70348') HTTP/1.1" 204 0
2026-03-29 18:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658
2026-03-29 18:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658
2026-03-29 18:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9d752ec-7828-572b-a9c6-59aed5aa7758 with identifier: LW29658 to the API
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:42:12Z',
'fuel_type': 'petrol',
'id': 'f9d752ec-7828-572b-a9c6-59aed5aa7758',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW29658',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 156625,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-30',
'seller_name': None,
'title': 'BMW 4er 428i',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW29658%27 HTTP/1.1" 200 None
2026-03-29 18:48:53 [auto1.de] INFO: Saving data for LW29658: {'auction_closing_time': 1774885332.0, 'created_time': 1773429370.304867, 'last_price_update_time': 1774810133.517249}
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW29658') HTTP/1.1" 204 0
2026-03-29 18:48:53 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-29 18:48:53 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-29 18:48:53 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-29 18:48:53 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ64066%27 HTTP/1.1" 200 None
2026-03-29 18:48:53 [auto1.de] INFO: Scrape type for JJ64066: 2
2026-03-29 18:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066
2026-03-29 18:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43631074-8476-56fd-8474-72438b800c53 with scrape type 2
2026-03-29 18:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43631074-8476-56fd-8474-72438b800c53 with scrape type 2
2026-03-29 18:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43631074-8476-56fd-8474-72438b800c53, identifier: JJ64066
2026-03-29 18:48:53 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV23135%27 HTTP/1.1" 200 None
2026-03-29 18:48:53 [auto1.de] INFO: Scrape type for DV23135: 2
2026-03-29 18:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135
2026-03-29 18:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff31bbc2-04c4-57b3-9358-8f70134967e1 with scrape type 2
2026-03-29 18:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff31bbc2-04c4-57b3-9358-8f70134967e1 with scrape type 2
2026-03-29 18:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff31bbc2-04c4-57b3-9358-8f70134967e1, identifier: DV23135
2026-03-29 18:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066
2026-03-29 18:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066
2026-03-29 18:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43631074-8476-56fd-8474-72438b800c53 with identifier: JJ64066 to the API
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:42:56Z',
'fuel_type': 'petrol',
'id': '43631074-8476-56fd-8474-72438b800c53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ64066',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 58168,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-02',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT IQ.DRIVE',
'transmission': 'manual',
'trim': 'IQ.DRIVE',
'year': 2019}
2026-03-29 18:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ64066%27 HTTP/1.1" 200 None
2026-03-29 18:48:54 [auto1.de] INFO: Saving data for JJ64066: {'auction_closing_time': 1774885376.0, 'created_time': 1774157729.200443, 'last_price_update_time': 1774810134.056017}
2026-03-29 18:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ64066') HTTP/1.1" 204 0
2026-03-29 18:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135
2026-03-29 18:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135
2026-03-29 18:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff31bbc2-04c4-57b3-9358-8f70134967e1 with identifier: DV23135 to the API
2026-03-29 18:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:49:24Z',
'fuel_type': 'diesel',
'id': 'ff31bbc2-04c4-57b3-9358-8f70134967e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV23135',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 130180,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-09',
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV23135%27 HTTP/1.1" 200 None
2026-03-29 18:48:55 [auto1.de] INFO: Saving data for DV23135: {'auction_closing_time': 1774885764.0, 'created_time': 1773402196.577748, 'last_price_update_time': 1774810135.1406}
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV23135') HTTP/1.1" 204 0
2026-03-29 18:48:55 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD22344%27 HTTP/1.1" 200 None
2026-03-29 18:48:55 [auto1.de] INFO: Scrape type for MD22344: 2
2026-03-29 18:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344
2026-03-29 18:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbdd504e-c145-5580-b504-e04fdf61b269 with scrape type 2
2026-03-29 18:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbdd504e-c145-5580-b504-e04fdf61b269 with scrape type 2
2026-03-29 18:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbdd504e-c145-5580-b504-e04fdf61b269, identifier: MD22344
2026-03-29 18:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344
2026-03-29 18:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344
2026-03-29 18:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbdd504e-c145-5580-b504-e04fdf61b269 with identifier: MD22344 to the API
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:26:34Z',
'fuel_type': 'petrol',
'id': 'cbdd504e-c145-5580-b504-e04fdf61b269',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD22344',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 136401,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-18',
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD22344%27 HTTP/1.1" 200 None
2026-03-29 18:48:55 [auto1.de] INFO: Saving data for MD22344: {'auction_closing_time': 1774884394.0, 'created_time': 1774723424.112328, 'last_price_update_time': 1774810135.533351}
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD22344') HTTP/1.1" 204 0
2026-03-29 18:48:55 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-29 18:48:55 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN95458%27 HTTP/1.1" 200 None
2026-03-29 18:48:55 [auto1.de] INFO: Scrape type for GN95458: 2
2026-03-29 18:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458
2026-03-29 18:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with scrape type 2
2026-03-29 18:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with scrape type 2
2026-03-29 18:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c, identifier: GN95458
2026-03-29 18:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458
2026-03-29 18:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458
2026-03-29 18:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 473c30f5-9434-5bb9-9f28-3e1ced61ff3c with identifier: GN95458 to the API
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:22:22Z',
'fuel_type': 'diesel',
'id': '473c30f5-9434-5bb9-9f28-3e1ced61ff3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN95458',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 257967,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-04',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
'transmission': 'automatic',
'trim': 'BlueMotion',
'year': 2012}
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN95458%27 HTTP/1.1" 200 None
2026-03-29 18:48:55 [auto1.de] INFO: Saving data for GN95458: {'auction_closing_time': 1774884142.0, 'created_time': 1774723423.704745, 'last_price_update_time': 1774810135.919996}
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN95458') HTTP/1.1" 204 0
2026-03-29 18:48:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:48:55 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG18767%27 HTTP/1.1" 200 None
2026-03-29 18:48:55 [auto1.de] INFO: Scrape type for ZG18767: 2
2026-03-29 18:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767
2026-03-29 18:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f254cf66-905e-5b8b-84ab-1b502f11f59f with scrape type 2
2026-03-29 18:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f254cf66-905e-5b8b-84ab-1b502f11f59f with scrape type 2
2026-03-29 18:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f254cf66-905e-5b8b-84ab-1b502f11f59f, identifier: ZG18767
2026-03-29 18:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767
2026-03-29 18:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767
2026-03-29 18:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f254cf66-905e-5b8b-84ab-1b502f11f59f with identifier: ZG18767 to the API
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:29:44Z',
'fuel_type': 'diesel',
'id': 'f254cf66-905e-5b8b-84ab-1b502f11f59f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG18767',
'listing': 'auction',
'make': 'Skoda',
'model': 'Yeti',
'odometer': 345618,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-28',
'seller_name': None,
'title': 'Skoda Yeti 2.0 TDI Ambition Outdoor',
'transmission': 'manual',
'trim': 'Ambition Outdoor',
'year': 2015}
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG18767%27 HTTP/1.1" 200 None
2026-03-29 18:48:56 [auto1.de] INFO: Saving data for ZG18767: {'auction_closing_time': 1774884584.0, 'created_time': 1774001895.575613, 'last_price_update_time': 1774810136.326864}
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG18767') HTTP/1.1" 204 0
2026-03-29 18:48:56 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-29 18:48:56 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM38106%27 HTTP/1.1" 200 None
2026-03-29 18:48:56 [auto1.de] INFO: Scrape type for TM38106: 2
2026-03-29 18:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106
2026-03-29 18:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e with scrape type 2
2026-03-29 18:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b8c5b06-f98b-5961-b34e-21a68d12f23e with scrape type 2
2026-03-29 18:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b8c5b06-f98b-5961-b34e-21a68d12f23e, identifier: TM38106
2026-03-29 18:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106
2026-03-29 18:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106
2026-03-29 18:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b8c5b06-f98b-5961-b34e-21a68d12f23e with identifier: TM38106 to the API
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:20:40Z',
'fuel_type': 'petrol',
'id': '4b8c5b06-f98b-5961-b34e-21a68d12f23e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM38106',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 158430,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-25',
'seller_name': None,
'title': 'Volkswagen Golf V 1.6 FSI Goal',
'transmission': 'manual',
'trim': 'Goal',
'year': 2006}
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM38106%27 HTTP/1.1" 200 None
2026-03-29 18:48:56 [auto1.de] INFO: Saving data for TM38106: {'auction_closing_time': 1774884040.0, 'created_time': 1774723422.364126, 'last_price_update_time': 1774810136.757071}
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM38106') HTTP/1.1" 204 0
2026-03-29 18:48:56 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK68896%27 HTTP/1.1" 200 None
2026-03-29 18:48:56 [auto1.de] INFO: Scrape type for TK68896: 2
2026-03-29 18:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896
2026-03-29 18:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with scrape type 2
2026-03-29 18:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with scrape type 2
2026-03-29 18:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2, identifier: TK68896
2026-03-29 18:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896
2026-03-29 18:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896
2026-03-29 18:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2 with identifier: TK68896 to the API
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:56:41Z',
'fuel_type': 'diesel',
'id': '7a1a4ee8-1acf-552d-9942-e0e0fe5b2dc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK68896',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 114581,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-09-21',
'seller_name': None,
'title': 'BMW X4 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK68896%27 HTTP/1.1" 200 None
2026-03-29 18:48:57 [auto1.de] INFO: Saving data for TK68896: {'auction_closing_time': 1774886201.0, 'created_time': 1774723466.250471, 'last_price_update_time': 1774810137.231755}
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK68896') HTTP/1.1" 204 0
2026-03-29 18:48:57 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6740 | hits on page: 40
2026-03-29 18:48:57 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-29 18:48:57 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89436%27 HTTP/1.1" 200 None
2026-03-29 18:48:57 [auto1.de] INFO: Scrape type for YN89436: 2
2026-03-29 18:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436
2026-03-29 18:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9327b681-153a-562d-8df0-ab745809eac3 with scrape type 2
2026-03-29 18:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9327b681-153a-562d-8df0-ab745809eac3 with scrape type 2
2026-03-29 18:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9327b681-153a-562d-8df0-ab745809eac3, identifier: YN89436
2026-03-29 18:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436
2026-03-29 18:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436
2026-03-29 18:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9327b681-153a-562d-8df0-ab745809eac3 with identifier: YN89436 to the API
2026-03-29 18:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:32:00Z',
'fuel_type': 'diesel',
'id': '9327b681-153a-562d-8df0-ab745809eac3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN89436',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 118663,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-10',
'seller_name': None,
'title': 'Opel Corsa 1.3 CDTI Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2008}
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89436%27 HTTP/1.1" 200 None
2026-03-29 18:48:58 [auto1.de] INFO: Saving data for YN89436: {'auction_closing_time': 1774884720.0, 'created_time': 1774723460.21043, 'last_price_update_time': 1774810138.598687}
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN89436') HTTP/1.1" 204 0
2026-03-29 18:48:58 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-29 18:48:58 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-29 18:48:58 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY12832%27 HTTP/1.1" 200 None
2026-03-29 18:48:58 [auto1.de] INFO: Scrape type for VY12832: 2
2026-03-29 18:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832
2026-03-29 18:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with scrape type 2
2026-03-29 18:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with scrape type 2
2026-03-29 18:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5375dfc-adc4-5284-b04f-bf1ee140cfb8, identifier: VY12832
2026-03-29 18:48:58 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-29 18:48:58 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-29 18:48:58 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-29 18:48:58 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM63573%27 HTTP/1.1" 200 None
2026-03-29 18:48:58 [auto1.de] INFO: Scrape type for PM63573: 2
2026-03-29 18:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573
2026-03-29 18:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with scrape type 2
2026-03-29 18:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with scrape type 2
2026-03-29 18:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b578d8e-fc2f-5134-bd13-7f1b9616de33, identifier: PM63573
2026-03-29 18:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832
2026-03-29 18:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832
2026-03-29 18:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5375dfc-adc4-5284-b04f-bf1ee140cfb8 with identifier: VY12832 to the API
2026-03-29 18:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:53:43Z',
'fuel_type': 'diesel',
'id': 'f5375dfc-adc4-5284-b04f-bf1ee140cfb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY12832',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 157922,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-21',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2014}
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY12832%27 HTTP/1.1" 200 None
2026-03-29 18:48:59 [auto1.de] INFO: Saving data for VY12832: {'auction_closing_time': 1774886023.0, 'created_time': 1773429707.428395, 'last_price_update_time': 1774810139.117107}
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY12832') HTTP/1.1" 204 0
2026-03-29 18:48:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573
2026-03-29 18:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573
2026-03-29 18:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b578d8e-fc2f-5134-bd13-7f1b9616de33 with identifier: PM63573 to the API
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:21:43Z',
'fuel_type': 'petrol',
'id': '3b578d8e-fc2f-5134-bd13-7f1b9616de33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM63573',
'listing': 'auction',
'make': 'Volvo',
'model': 'V50',
'odometer': 247318,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-09',
'seller_name': None,
'title': 'Volvo V50 1.8 F Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2009}
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM63573%27 HTTP/1.1" 200 None
2026-03-29 18:48:59 [auto1.de] INFO: Saving data for PM63573: {'auction_closing_time': 1774884103.0, 'created_time': 1774723452.054569, 'last_price_update_time': 1774810139.435429}
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM63573') HTTP/1.1" 204 0
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW05091%27 HTTP/1.1" 200 None
2026-03-29 18:48:59 [auto1.de] INFO: Scrape type for FW05091: 2
2026-03-29 18:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091
2026-03-29 18:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93057221-a1d6-5f44-bca6-b1199f4280d7 with scrape type 2
2026-03-29 18:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93057221-a1d6-5f44-bca6-b1199f4280d7 with scrape type 2
2026-03-29 18:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93057221-a1d6-5f44-bca6-b1199f4280d7, identifier: FW05091
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-29 18:48:59 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW86530%27 HTTP/1.1" 200 None
2026-03-29 18:48:59 [auto1.de] INFO: Scrape type for YW86530: 2
2026-03-29 18:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530
2026-03-29 18:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c67b7d7-20b7-5df0-994d-362db3f12f42 with scrape type 2
2026-03-29 18:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c67b7d7-20b7-5df0-994d-362db3f12f42 with scrape type 2
2026-03-29 18:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c67b7d7-20b7-5df0-994d-362db3f12f42, identifier: YW86530
2026-03-29 18:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091
2026-03-29 18:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091
2026-03-29 18:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93057221-a1d6-5f44-bca6-b1199f4280d7 with identifier: FW05091 to the API
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:48:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:02:35Z',
'fuel_type': 'petrol',
'id': '93057221-a1d6-5f44-bca6-b1199f4280d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW05091',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 35008,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-06',
'seller_name': None,
'title': 'Volkswagen Polo 1.8 TSI GTI BlueMotion Tech',
'transmission': 'manual',
'trim': 'GTI BlueMotion Tech',
'year': 2016}
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW05091%27 HTTP/1.1" 200 None
2026-03-29 18:48:59 [auto1.de] INFO: Saving data for FW05091: {'auction_closing_time': 1774882955.0, 'created_time': 1774723458.582194, 'last_price_update_time': 1774810139.945011}
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW05091') HTTP/1.1" 204 0
2026-03-29 18:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530
2026-03-29 18:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530
2026-03-29 18:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c67b7d7-20b7-5df0-994d-362db3f12f42 with identifier: YW86530 to the API
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:17:10Z',
'fuel_type': 'diesel',
'id': '4c67b7d7-20b7-5df0-994d-362db3f12f42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW86530',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 293583,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-06',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2016}
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW86530%27 HTTP/1.1" 200 None
2026-03-29 18:49:00 [auto1.de] INFO: Saving data for YW86530: {'auction_closing_time': 1774883830.0, 'created_time': 1774723467.682235, 'last_price_update_time': 1774810140.340201}
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW86530') HTTP/1.1" 204 0
2026-03-29 18:49:00 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ02782%27 HTTP/1.1" 200 None
2026-03-29 18:49:00 [auto1.de] INFO: Scrape type for AZ02782: 2
2026-03-29 18:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782
2026-03-29 18:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b96697-f0d5-51a2-99bd-a75d924e95ad with scrape type 2
2026-03-29 18:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83b96697-f0d5-51a2-99bd-a75d924e95ad with scrape type 2
2026-03-29 18:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83b96697-f0d5-51a2-99bd-a75d924e95ad, identifier: AZ02782
2026-03-29 18:49:00 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-29 18:49:00 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE57631%27 HTTP/1.1" 200 None
2026-03-29 18:49:00 [auto1.de] INFO: Scrape type for WE57631: 2
2026-03-29 18:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631
2026-03-29 18:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with scrape type 2
2026-03-29 18:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with scrape type 2
2026-03-29 18:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52, identifier: WE57631
2026-03-29 18:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782
2026-03-29 18:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782
2026-03-29 18:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83b96697-f0d5-51a2-99bd-a75d924e95ad with identifier: AZ02782 to the API
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:28:57Z',
'fuel_type': 'petrol',
'id': '83b96697-f0d5-51a2-99bd-a75d924e95ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ02782',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 221435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-20',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2013}
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ02782%27 HTTP/1.1" 200 None
2026-03-29 18:49:00 [auto1.de] INFO: Saving data for AZ02782: {'auction_closing_time': 1774884537.0, 'created_time': 1774723713.430015, 'last_price_update_time': 1774810140.872003}
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ02782') HTTP/1.1" 204 0
2026-03-29 18:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631
2026-03-29 18:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631
2026-03-29 18:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40fa1fac-df1f-52c8-8442-6b4fc8af3c52 with identifier: WE57631 to the API
2026-03-29 18:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:44Z',
'fuel_type': 'diesel',
'id': '40fa1fac-df1f-52c8-8442-6b4fc8af3c52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE57631',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 169152,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-03',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI IQ.DRIVE',
'transmission': 'automatic',
'trim': 'IQ.DRIVE',
'year': 2019}
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE57631%27 HTTP/1.1" 200 None
2026-03-29 18:49:01 [auto1.de] INFO: Saving data for WE57631: {'auction_closing_time': 1774884284.0, 'created_time': 1773427478.670085, 'last_price_update_time': 1774810141.597071}
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE57631') HTTP/1.1" 204 0
2026-03-29 18:49:01 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-29 18:49:01 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-29 18:49:01 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD24318%27 HTTP/1.1" 200 None
2026-03-29 18:49:01 [auto1.de] INFO: Scrape type for YD24318: 2
2026-03-29 18:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318
2026-03-29 18:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with scrape type 2
2026-03-29 18:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with scrape type 2
2026-03-29 18:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ed97780-76bd-5aed-92fe-9ef5de9494f1, identifier: YD24318
2026-03-29 18:49:01 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-29 18:49:01 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-29 18:49:01 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR20146%27 HTTP/1.1" 200 None
2026-03-29 18:49:01 [auto1.de] INFO: Scrape type for XR20146: 2
2026-03-29 18:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146
2026-03-29 18:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11d8dc04-8894-58ec-99cd-30b3ffab662e with scrape type 2
2026-03-29 18:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11d8dc04-8894-58ec-99cd-30b3ffab662e with scrape type 2
2026-03-29 18:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11d8dc04-8894-58ec-99cd-30b3ffab662e, identifier: XR20146
2026-03-29 18:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318
2026-03-29 18:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318
2026-03-29 18:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ed97780-76bd-5aed-92fe-9ef5de9494f1 with identifier: YD24318 to the API
2026-03-29 18:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:07:28Z',
'fuel_type': 'diesel',
'id': '0ed97780-76bd-5aed-92fe-9ef5de9494f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD24318',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 112984,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-05',
'seller_name': None,
'title': 'Mercedes-Benz Citan 111 CDI lang Tourer Edition',
'transmission': 'manual',
'trim': 'lang Tourer Edition',
'year': 2020}
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD24318%27 HTTP/1.1" 200 None
2026-03-29 18:49:02 [auto1.de] INFO: Saving data for YD24318: {'auction_closing_time': 1774883248.0, 'created_time': 1774723714.616011, 'last_price_update_time': 1774810142.124248}
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD24318') HTTP/1.1" 204 0
2026-03-29 18:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146
2026-03-29 18:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146
2026-03-29 18:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11d8dc04-8894-58ec-99cd-30b3ffab662e with identifier: XR20146 to the API
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:29:39Z',
'fuel_type': 'diesel',
'id': '11d8dc04-8894-58ec-99cd-30b3ffab662e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR20146',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 203146,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-30',
'seller_name': None,
'title': 'Ford Mondeo 2.0 TDCi Titanium S',
'transmission': 'automatic',
'trim': 'Titanium S',
'year': 2013}
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR20146%27 HTTP/1.1" 200 None
2026-03-29 18:49:02 [auto1.de] INFO: Saving data for XR20146: {'auction_closing_time': 1774884579.0, 'created_time': 1774723459.337788, 'last_price_update_time': 1774810142.403395}
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR20146') HTTP/1.1" 204 0
2026-03-29 18:49:02 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ76900%27 HTTP/1.1" 200 None
2026-03-29 18:49:02 [auto1.de] INFO: Scrape type for FZ76900: 2
2026-03-29 18:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900
2026-03-29 18:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with scrape type 2
2026-03-29 18:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with scrape type 2
2026-03-29 18:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc, identifier: FZ76900
2026-03-29 18:49:02 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL75454%27 HTTP/1.1" 200 None
2026-03-29 18:49:02 [auto1.de] INFO: Scrape type for RL75454: 2
2026-03-29 18:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454
2026-03-29 18:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with scrape type 2
2026-03-29 18:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with scrape type 2
2026-03-29 18:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e17c68c-c8d9-5f6f-a16e-b92948f10512, identifier: RL75454
2026-03-29 18:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900
2026-03-29 18:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900
2026-03-29 18:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d312d8d-b5cf-5660-bffa-a48e5cdaaedc with identifier: FZ76900 to the API
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:40:04Z',
'fuel_type': 'petrol',
'id': '0d312d8d-b5cf-5660-bffa-a48e5cdaaedc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ76900',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 102895,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-28',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ76900%27 HTTP/1.1" 200 None
2026-03-29 18:49:02 [auto1.de] INFO: Saving data for FZ76900: {'auction_closing_time': 1774885204.0, 'created_time': 1774723706.811403, 'last_price_update_time': 1774810142.93205}
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ76900') HTTP/1.1" 204 0
2026-03-29 18:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454
2026-03-29 18:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454
2026-03-29 18:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e17c68c-c8d9-5f6f-a16e-b92948f10512 with identifier: RL75454 to the API
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:04:17Z',
'fuel_type': 'petrol',
'id': '5e17c68c-c8d9-5f6f-a16e-b92948f10512',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL75454',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 124926,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-06',
'seller_name': None,
'title': 'Audi Q5 2.0 TFSI quattro Design',
'transmission': 'automatic',
'trim': 'quattro Design',
'year': 2018}
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL75454%27 HTTP/1.1" 200 None
2026-03-29 18:49:03 [auto1.de] INFO: Saving data for RL75454: {'auction_closing_time': 1774883057.0, 'created_time': 1774723620.524612, 'last_price_update_time': 1774810143.32332}
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL75454') HTTP/1.1" 204 0
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS79135%27 HTTP/1.1" 200 None
2026-03-29 18:49:03 [auto1.de] INFO: Scrape type for PS79135: 2
2026-03-29 18:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135
2026-03-29 18:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dbdf91-7561-58c2-8e0d-cba238364bf9 with scrape type 2
2026-03-29 18:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55dbdf91-7561-58c2-8e0d-cba238364bf9 with scrape type 2
2026-03-29 18:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55dbdf91-7561-58c2-8e0d-cba238364bf9, identifier: PS79135
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-29 18:49:03 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL40114%27 HTTP/1.1" 200 None
2026-03-29 18:49:03 [auto1.de] INFO: Scrape type for FL40114: 2
2026-03-29 18:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114
2026-03-29 18:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4897e43-6225-5ee6-b82e-5ee2f1792de2 with scrape type 2
2026-03-29 18:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4897e43-6225-5ee6-b82e-5ee2f1792de2 with scrape type 2
2026-03-29 18:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4897e43-6225-5ee6-b82e-5ee2f1792de2, identifier: FL40114
2026-03-29 18:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135
2026-03-29 18:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135
2026-03-29 18:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55dbdf91-7561-58c2-8e0d-cba238364bf9 with identifier: PS79135 to the API
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:43:15Z',
'fuel_type': 'petrol',
'id': '55dbdf91-7561-58c2-8e0d-cba238364bf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS79135',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 188068,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-10',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2013}
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS79135%27 HTTP/1.1" 200 None
2026-03-29 18:49:03 [auto1.de] INFO: Saving data for PS79135: {'auction_closing_time': 1774885395.0, 'created_time': 1774723498.966873, 'last_price_update_time': 1774810143.881902}
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS79135') HTTP/1.1" 204 0
2026-03-29 18:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114
2026-03-29 18:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114
2026-03-29 18:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4897e43-6225-5ee6-b82e-5ee2f1792de2 with identifier: FL40114 to the API
2026-03-29 18:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:29:10Z',
'fuel_type': 'petrol',
'id': 'b4897e43-6225-5ee6-b82e-5ee2f1792de2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL40114',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 93318,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-17',
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
'transmission': 'automatic',
'trim': 'Limited 4WD',
'year': 2018}
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL40114%27 HTTP/1.1" 200 None
2026-03-29 18:49:04 [auto1.de] INFO: Saving data for FL40114: {'auction_closing_time': 1774884550.0, 'created_time': 1774033181.863242, 'last_price_update_time': 1774810144.158381}
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL40114') HTTP/1.1" 204 0
2026-03-29 18:49:04 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-29 18:49:04 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-29 18:49:04 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-29 18:49:04 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-29 18:49:04 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE05181%27 HTTP/1.1" 200 None
2026-03-29 18:49:04 [auto1.de] INFO: Scrape type for JE05181: 2
2026-03-29 18:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181
2026-03-29 18:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab669a74-303c-5a85-a8f6-f791c72f666d with scrape type 2
2026-03-29 18:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab669a74-303c-5a85-a8f6-f791c72f666d with scrape type 2
2026-03-29 18:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab669a74-303c-5a85-a8f6-f791c72f666d, identifier: JE05181
2026-03-29 18:49:04 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-29 18:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181
2026-03-29 18:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181
2026-03-29 18:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab669a74-303c-5a85-a8f6-f791c72f666d with identifier: JE05181 to the API
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:11:56Z',
'fuel_type': 'diesel',
'id': 'ab669a74-303c-5a85-a8f6-f791c72f666d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE05181',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 166995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-11',
'seller_name': None,
'title': 'Ford Fiesta 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2016}
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE05181%27 HTTP/1.1" 200 None
2026-03-29 18:49:04 [auto1.de] INFO: Saving data for JE05181: {'auction_closing_time': 1774883516.0, 'created_time': 1773380136.14717, 'last_price_update_time': 1774810144.577355}
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE05181') HTTP/1.1" 204 0
2026-03-29 18:49:04 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ68363%27 HTTP/1.1" 200 None
2026-03-29 18:49:04 [auto1.de] INFO: Scrape type for LZ68363: 2
2026-03-29 18:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363
2026-03-29 18:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c69c94-1789-5f50-abc3-8db0ad0290e2 with scrape type 2
2026-03-29 18:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80c69c94-1789-5f50-abc3-8db0ad0290e2 with scrape type 2
2026-03-29 18:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80c69c94-1789-5f50-abc3-8db0ad0290e2, identifier: LZ68363
2026-03-29 18:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363
2026-03-29 18:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363
2026-03-29 18:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80c69c94-1789-5f50-abc3-8db0ad0290e2 with identifier: LZ68363 to the API
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-30T15:05:07Z',
'fuel_type': 'petrol',
'id': '80c69c94-1789-5f50-abc3-8db0ad0290e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ68363',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 65951,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-15',
'seller_name': None,
'title': 'MINI Clubman John Cooper Works ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2021}
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ68363%27 HTTP/1.1" 200 None
2026-03-29 18:49:05 [auto1.de] INFO: Saving data for LZ68363: {'auction_closing_time': 1774883107.0, 'created_time': 1773400625.874955, 'last_price_update_time': 1774810145.089269}
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ68363') HTTP/1.1" 204 0
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL66615%27 HTTP/1.1" 200 None
2026-03-29 18:49:05 [auto1.de] INFO: Scrape type for XL66615: 2
2026-03-29 18:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615
2026-03-29 18:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with scrape type 2
2026-03-29 18:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with scrape type 2
2026-03-29 18:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a, identifier: XL66615
2026-03-29 18:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615
2026-03-29 18:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615
2026-03-29 18:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a with identifier: XL66615 to the API
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 510,
'expiration_date': '2026-03-30T15:24:18Z',
'fuel_type': 'petrol',
'id': '82b0bb0e-3ca2-5ea5-8c2d-c70d9ef2af4a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL66615',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 104360,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-08',
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.9 V6 Quadrifoglio Q4',
'transmission': 'automatic',
'trim': 'Quadrifoglio Q4',
'year': 2019}
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL66615%27 HTTP/1.1" 200 None
2026-03-29 18:49:05 [auto1.de] INFO: Saving data for XL66615: {'auction_closing_time': 1774884258.0, 'created_time': 1774723471.405357, 'last_price_update_time': 1774810145.488708}
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL66615') HTTP/1.1" 204 0
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53111%27 HTTP/1.1" 200 None
2026-03-29 18:49:05 [auto1.de] INFO: Scrape type for UA53111: 2
2026-03-29 18:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111
2026-03-29 18:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67fe3d5d-bcec-5da0-967d-974bce60c94a with scrape type 2
2026-03-29 18:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67fe3d5d-bcec-5da0-967d-974bce60c94a with scrape type 2
2026-03-29 18:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67fe3d5d-bcec-5da0-967d-974bce60c94a, identifier: UA53111
2026-03-29 18:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111
2026-03-29 18:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111
2026-03-29 18:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67fe3d5d-bcec-5da0-967d-974bce60c94a with identifier: UA53111 to the API
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:41:50Z',
'fuel_type': 'petrol',
'id': '67fe3d5d-bcec-5da0-967d-974bce60c94a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA53111',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 98141,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-26',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53111%27 HTTP/1.1" 200 None
2026-03-29 18:49:05 [auto1.de] INFO: Saving data for UA53111: {'auction_closing_time': 1774885310.0, 'created_time': 1774723547.684878, 'last_price_update_time': 1774810145.914887}
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA53111') HTTP/1.1" 204 0
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-29 18:49:05 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL33602%27 HTTP/1.1" 200 None
2026-03-29 18:49:05 [auto1.de] INFO: Scrape type for PL33602: 2
2026-03-29 18:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602
2026-03-29 18:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b with scrape type 2
2026-03-29 18:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce9fead6-196c-50bf-ad4f-a3bf19212a9b with scrape type 2
2026-03-29 18:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce9fead6-196c-50bf-ad4f-a3bf19212a9b, identifier: PL33602
2026-03-29 18:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602
2026-03-29 18:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602
2026-03-29 18:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce9fead6-196c-50bf-ad4f-a3bf19212a9b with identifier: PL33602 to the API
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 225,
'expiration_date': '2026-03-30T15:40:41Z',
'fuel_type': 'diesel',
'id': 'ce9fead6-196c-50bf-ad4f-a3bf19212a9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL33602',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 379367,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-26',
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2007}
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL33602%27 HTTP/1.1" 200 None
2026-03-29 18:49:06 [auto1.de] INFO: Saving data for PL33602: {'auction_closing_time': 1774885241.0, 'created_time': 1774723716.227619, 'last_price_update_time': 1774810146.328674}
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL33602') HTTP/1.1" 204 0
2026-03-29 18:49:06 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-29 18:49:06 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN24216%27 HTTP/1.1" 200 None
2026-03-29 18:49:06 [auto1.de] INFO: Scrape type for SN24216: 2
2026-03-29 18:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216
2026-03-29 18:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 083f99fc-1d09-523b-b4c0-2841d2eb805d with scrape type 2
2026-03-29 18:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 083f99fc-1d09-523b-b4c0-2841d2eb805d with scrape type 2
2026-03-29 18:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 083f99fc-1d09-523b-b4c0-2841d2eb805d, identifier: SN24216
2026-03-29 18:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:06 [scrapy.extensions.logstats] INFO: Crawled 156 pages (at 8 pages/min), scraped 1434 items (at 131 items/min)
2026-03-29 18:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216
2026-03-29 18:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216
2026-03-29 18:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 083f99fc-1d09-523b-b4c0-2841d2eb805d with identifier: SN24216 to the API
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 285,
'expiration_date': '2026-03-30T15:58:40Z',
'fuel_type': 'diesel',
'id': '083f99fc-1d09-523b-b4c0-2841d2eb805d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN24216',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 358594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-05',
'seller_name': None,
'title': 'BMW 5er 535d',
'transmission': 'automatic',
'trim': '',
'year': 2008}
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN24216%27 HTTP/1.1" 200 None
2026-03-29 18:49:06 [auto1.de] INFO: Saving data for SN24216: {'auction_closing_time': 1774886320.0, 'created_time': 1774034533.735024, 'last_price_update_time': 1774810146.814239}
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN24216') HTTP/1.1" 204 0
2026-03-29 18:49:06 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR44802%27 HTTP/1.1" 200 None
2026-03-29 18:49:06 [auto1.de] INFO: Scrape type for PR44802: 2
2026-03-29 18:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802
2026-03-29 18:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f with scrape type 2
2026-03-29 18:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b18cf49-041a-5c48-89bc-9b5a0db4388f with scrape type 2
2026-03-29 18:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b18cf49-041a-5c48-89bc-9b5a0db4388f, identifier: PR44802
2026-03-29 18:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802
2026-03-29 18:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802
2026-03-29 18:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b18cf49-041a-5c48-89bc-9b5a0db4388f with identifier: PR44802 to the API
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:50:18Z',
'fuel_type': 'petrol',
'id': '6b18cf49-041a-5c48-89bc-9b5a0db4388f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR44802',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 151429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-15',
'seller_name': None,
'title': 'Seat Ibiza 1.2 TSI Style Salsa',
'transmission': 'manual',
'trim': 'Style Salsa',
'year': 2014}
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR44802%27 HTTP/1.1" 200 None
2026-03-29 18:49:07 [auto1.de] INFO: Saving data for PR44802: {'auction_closing_time': 1774885818.0, 'created_time': 1774723719.389118, 'last_price_update_time': 1774810147.208633}
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR44802') HTTP/1.1" 204 0
2026-03-29 18:49:07 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-29 18:49:07 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-29 18:49:07 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-29 18:49:07 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-29 18:49:07 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ49270%27 HTTP/1.1" 200 None
2026-03-29 18:49:07 [auto1.de] INFO: Scrape type for KJ49270: 2
2026-03-29 18:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270
2026-03-29 18:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10bf9abd-ed49-5e26-8d07-67425d4023ae with scrape type 2
2026-03-29 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10bf9abd-ed49-5e26-8d07-67425d4023ae with scrape type 2
2026-03-29 18:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10bf9abd-ed49-5e26-8d07-67425d4023ae, identifier: KJ49270
2026-03-29 18:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270
2026-03-29 18:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270
2026-03-29 18:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10bf9abd-ed49-5e26-8d07-67425d4023ae with identifier: KJ49270 to the API
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:20:18Z',
'fuel_type': 'petrol',
'id': '10bf9abd-ed49-5e26-8d07-67425d4023ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ49270',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 110910,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-13',
'seller_name': None,
'title': 'Seat Ibiza 1.4 I-Tech',
'transmission': 'manual',
'trim': 'I-Tech',
'year': 2014}
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ49270%27 HTTP/1.1" 200 None
2026-03-29 18:49:07 [auto1.de] INFO: Saving data for KJ49270: {'auction_closing_time': 1774884018.0, 'created_time': 1774723700.06533, 'last_price_update_time': 1774810147.600641}
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ49270') HTTP/1.1" 204 0
2026-03-29 18:49:07 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6740 | hits on page: 40
2026-03-29 18:49:07 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15058%27 HTTP/1.1" 200 None
2026-03-29 18:49:07 [auto1.de] INFO: Scrape type for ZD15058: 2
2026-03-29 18:49:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058
2026-03-29 18:49:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with scrape type 2
2026-03-29 18:49:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with scrape type 2
2026-03-29 18:49:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd2f9cbb-223f-5f8b-8ee5-2863563118b2, identifier: ZD15058
2026-03-29 18:49:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058
2026-03-29 18:49:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058
2026-03-29 18:49:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd2f9cbb-223f-5f8b-8ee5-2863563118b2 with identifier: ZD15058 to the API
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:16:13Z',
'fuel_type': 'diesel',
'id': 'cd2f9cbb-223f-5f8b-8ee5-2863563118b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD15058',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 57454,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-12-18',
'seller_name': None,
'title': 'Renault Master 2.3 dCi L3H1 3,5t',
'transmission': 'manual',
'trim': 'L3H1 3,5t',
'year': 2017}
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15058%27 HTTP/1.1" 200 None
2026-03-29 18:49:08 [auto1.de] INFO: Saving data for ZD15058: {'auction_closing_time': 1774883773.0, 'created_time': 1774350136.132089, 'last_price_update_time': 1774810148.017027}
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD15058') HTTP/1.1" 204 0
2026-03-29 18:49:08 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79425%27 HTTP/1.1" 200 None
2026-03-29 18:49:08 [auto1.de] INFO: Scrape type for NR79425: 2
2026-03-29 18:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425
2026-03-29 18:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item defa7b68-3dd7-559f-92dd-8169e04cc51a with scrape type 2
2026-03-29 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item defa7b68-3dd7-559f-92dd-8169e04cc51a with scrape type 2
2026-03-29 18:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: defa7b68-3dd7-559f-92dd-8169e04cc51a, identifier: NR79425
2026-03-29 18:49:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:49:08 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-29 18:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425
2026-03-29 18:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425
2026-03-29 18:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: defa7b68-3dd7-559f-92dd-8169e04cc51a with identifier: NR79425 to the API
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:03:15Z',
'fuel_type': 'petrol',
'id': 'defa7b68-3dd7-559f-92dd-8169e04cc51a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR79425',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 58782,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-30',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2014}
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79425%27 HTTP/1.1" 200 None
2026-03-29 18:49:08 [auto1.de] INFO: Saving data for NR79425: {'auction_closing_time': 1774882995.0, 'created_time': 1774723670.97571, 'last_price_update_time': 1774810148.407356}
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR79425') HTTP/1.1" 204 0
2026-03-29 18:49:08 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-29 18:49:08 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03546%27 HTTP/1.1" 200 None
2026-03-29 18:49:08 [auto1.de] INFO: Scrape type for UF03546: 2
2026-03-29 18:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546
2026-03-29 18:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660208e9-4689-58fc-8fb6-8d813a0ddfdd with scrape type 2
2026-03-29 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 660208e9-4689-58fc-8fb6-8d813a0ddfdd with scrape type 2
2026-03-29 18:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 660208e9-4689-58fc-8fb6-8d813a0ddfdd, identifier: UF03546
2026-03-29 18:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546
2026-03-29 18:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546
2026-03-29 18:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 660208e9-4689-58fc-8fb6-8d813a0ddfdd with identifier: UF03546 to the API
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:51:09Z',
'fuel_type': 'petrol',
'id': '660208e9-4689-58fc-8fb6-8d813a0ddfdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF03546',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 39726,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-16',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03546%27 HTTP/1.1" 200 None
2026-03-29 18:49:08 [auto1.de] INFO: Saving data for UF03546: {'auction_closing_time': 1774885869.0, 'created_time': 1774723541.127051, 'last_price_update_time': 1774810148.922408}
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF03546') HTTP/1.1" 204 0
2026-03-29 18:49:08 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-29 18:49:08 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-29 18:49:08 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU29396%27 HTTP/1.1" 200 None
2026-03-29 18:49:08 [auto1.de] INFO: Scrape type for WU29396: 2
2026-03-29 18:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396
2026-03-29 18:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e with scrape type 2
2026-03-29 18:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5193fb67-ff68-5bf9-aae2-de74f3b7460e with scrape type 2
2026-03-29 18:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5193fb67-ff68-5bf9-aae2-de74f3b7460e, identifier: WU29396
2026-03-29 18:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396
2026-03-29 18:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396
2026-03-29 18:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5193fb67-ff68-5bf9-aae2-de74f3b7460e with identifier: WU29396 to the API
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:41:19Z',
'fuel_type': 'petrol',
'id': '5193fb67-ff68-5bf9-aae2-de74f3b7460e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU29396',
'listing': 'auction',
'make': 'MINI',
'model': 'Cabrio',
'odometer': 30962,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-06',
'seller_name': None,
'title': 'MINI Cabrio Cooper S',
'transmission': 'manual',
'trim': '',
'year': 2020}
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU29396%27 HTTP/1.1" 200 None
2026-03-29 18:49:09 [auto1.de] INFO: Saving data for WU29396: {'auction_closing_time': 1774885279.0, 'created_time': 1774723521.378207, 'last_price_update_time': 1774810149.324755}
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU29396') HTTP/1.1" 204 0
2026-03-29 18:49:09 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-29 18:49:09 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-29 18:49:09 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM47126%27 HTTP/1.1" 200 None
2026-03-29 18:49:09 [auto1.de] INFO: Scrape type for LM47126: 2
2026-03-29 18:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126
2026-03-29 18:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593adad4-ce90-5b52-99e2-41b1879a42bd with scrape type 2
2026-03-29 18:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593adad4-ce90-5b52-99e2-41b1879a42bd with scrape type 2
2026-03-29 18:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 593adad4-ce90-5b52-99e2-41b1879a42bd, identifier: LM47126
2026-03-29 18:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126
2026-03-29 18:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126
2026-03-29 18:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 593adad4-ce90-5b52-99e2-41b1879a42bd with identifier: LM47126 to the API
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:34:20Z',
'fuel_type': 'petrol',
'id': '593adad4-ce90-5b52-99e2-41b1879a42bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM47126',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 91084,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-07',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2010}
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM47126%27 HTTP/1.1" 200 None
2026-03-29 18:49:09 [auto1.de] INFO: Saving data for LM47126: {'auction_closing_time': 1774884860.0, 'created_time': 1774723477.670643, 'last_price_update_time': 1774810149.721281}
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM47126') HTTP/1.1" 204 0
2026-03-29 18:49:09 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-29 18:49:09 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-29 18:49:09 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU09493%27 HTTP/1.1" 200 None
2026-03-29 18:49:09 [auto1.de] INFO: Scrape type for MU09493: 2
2026-03-29 18:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493
2026-03-29 18:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f817086f-9b8d-58d2-abb9-afae8991c669 with scrape type 2
2026-03-29 18:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f817086f-9b8d-58d2-abb9-afae8991c669 with scrape type 2
2026-03-29 18:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f817086f-9b8d-58d2-abb9-afae8991c669, identifier: MU09493
2026-03-29 18:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493
2026-03-29 18:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493
2026-03-29 18:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f817086f-9b8d-58d2-abb9-afae8991c669 with identifier: MU09493 to the API
2026-03-29 18:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:07:54Z',
'fuel_type': 'diesel',
'id': 'f817086f-9b8d-58d2-abb9-afae8991c669',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU09493',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 268179,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-28',
'seller_name': None,
'title': 'BMW 3er 325d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU09493%27 HTTP/1.1" 200 None
2026-03-29 18:49:10 [auto1.de] INFO: Saving data for MU09493: {'auction_closing_time': 1774883274.0, 'created_time': 1774723675.789133, 'last_price_update_time': 1774810150.120997}
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU09493') HTTP/1.1" 204 0
2026-03-29 18:49:10 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-29 18:49:10 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-29 18:49:10 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60589%27 HTTP/1.1" 200 None
2026-03-29 18:49:10 [auto1.de] INFO: Scrape type for EF60589: 2
2026-03-29 18:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589
2026-03-29 18:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with scrape type 2
2026-03-29 18:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with scrape type 2
2026-03-29 18:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871, identifier: EF60589
2026-03-29 18:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589
2026-03-29 18:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589
2026-03-29 18:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0fb22f0-b1ef-5d14-8cd8-5209b62b7871 with identifier: EF60589 to the API
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:46:11Z',
'fuel_type': 'diesel',
'id': 'e0fb22f0-b1ef-5d14-8cd8-5209b62b7871',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF60589',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 176074,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-05',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Dynamic Start/Stop',
'transmission': 'manual',
'trim': 'Dynamic Start/Stop',
'year': 2017}
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60589%27 HTTP/1.1" 200 None
2026-03-29 18:49:10 [auto1.de] INFO: Saving data for EF60589: {'auction_closing_time': 1774885571.0, 'created_time': 1774350291.629463, 'last_price_update_time': 1774810150.609229}
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF60589') HTTP/1.1" 204 0
2026-03-29 18:49:10 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72428%27 HTTP/1.1" 200 None
2026-03-29 18:49:10 [auto1.de] INFO: Scrape type for MR72428: 2
2026-03-29 18:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428
2026-03-29 18:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a37e25-e516-585f-88a3-031569e62087 with scrape type 2
2026-03-29 18:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2a37e25-e516-585f-88a3-031569e62087 with scrape type 2
2026-03-29 18:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a37e25-e516-585f-88a3-031569e62087, identifier: MR72428
2026-03-29 18:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428
2026-03-29 18:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428
2026-03-29 18:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a37e25-e516-585f-88a3-031569e62087 with identifier: MR72428 to the API
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 227,
'expiration_date': '2026-03-30T15:21:59Z',
'fuel_type': 'petrol',
'id': 'a2a37e25-e516-585f-88a3-031569e62087',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR72428',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLE-Klasse',
'odometer': 1193,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-07-30',
'seller_name': None,
'title': 'Mercedes-Benz CLE-Klasse CLE 200 Mild-Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2025}
2026-03-29 18:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72428%27 HTTP/1.1" 200 None
2026-03-29 18:49:11 [auto1.de] INFO: Saving data for MR72428: {'auction_closing_time': 1774884119.0, 'created_time': 1774723478.09875, 'last_price_update_time': 1774810151.002319}
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR72428') HTTP/1.1" 204 0
2026-03-29 18:49:11 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT14776%27 HTTP/1.1" 200 None
2026-03-29 18:49:11 [auto1.de] INFO: Scrape type for UT14776: 2
2026-03-29 18:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776
2026-03-29 18:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with scrape type 2
2026-03-29 18:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with scrape type 2
2026-03-29 18:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c, identifier: UT14776
2026-03-29 18:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776
2026-03-29 18:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776
2026-03-29 18:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c with identifier: UT14776 to the API
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:29:05Z',
'fuel_type': 'petrol',
'id': '18a6cf04-ac91-5b0d-8c79-bb0e40bcb61c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT14776',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 253504,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-10-11',
'seller_name': None,
'title': 'BMW 5er 530i',
'transmission': 'automatic',
'trim': '',
'year': 2000}
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT14776%27 HTTP/1.1" 200 None
2026-03-29 18:49:11 [auto1.de] INFO: Saving data for UT14776: {'auction_closing_time': 1774884545.0, 'created_time': 1774723526.311893, 'last_price_update_time': 1774810151.404507}
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT14776') HTTP/1.1" 204 0
2026-03-29 18:49:11 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-29 18:49:11 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR58414%27 HTTP/1.1" 200 None
2026-03-29 18:49:11 [auto1.de] INFO: Scrape type for LR58414: 2
2026-03-29 18:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414
2026-03-29 18:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with scrape type 2
2026-03-29 18:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with scrape type 2
2026-03-29 18:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0, identifier: LR58414
2026-03-29 18:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414
2026-03-29 18:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414
2026-03-29 18:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e37dacc-9c41-52a3-90cf-4c72a4137ca0 with identifier: LR58414 to the API
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:45:16Z',
'fuel_type': 'diesel',
'id': '1e37dacc-9c41-52a3-90cf-4c72a4137ca0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR58414',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Country Tourer',
'odometer': 124598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-19',
'seller_name': None,
'title': 'Opel Insignia Country Tourer 2.0 CDTI Basis 4x4',
'transmission': 'automatic',
'trim': 'Basis 4x4',
'year': 2020}
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR58414%27 HTTP/1.1" 200 None
2026-03-29 18:49:11 [auto1.de] INFO: Saving data for LR58414: {'auction_closing_time': 1774885516.0, 'created_time': 1774723628.08083, 'last_price_update_time': 1774810151.810917}
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR58414') HTTP/1.1" 204 0
2026-03-29 18:49:11 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-29 18:49:11 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN17555%27 HTTP/1.1" 200 None
2026-03-29 18:49:11 [auto1.de] INFO: Scrape type for EN17555: 2
2026-03-29 18:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555
2026-03-29 18:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with scrape type 2
2026-03-29 18:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with scrape type 2
2026-03-29 18:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac, identifier: EN17555
2026-03-29 18:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555
2026-03-29 18:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555
2026-03-29 18:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43b8ba5d-a6d6-5007-a0e8-625995e9b2ac with identifier: EN17555 to the API
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:07:30Z',
'fuel_type': 'petrol',
'id': '43b8ba5d-a6d6-5007-a0e8-625995e9b2ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN17555',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Fox',
'odometer': 120654,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-14',
'seller_name': None,
'title': 'Volkswagen Fox 1.2 Refresh',
'transmission': 'manual',
'trim': 'Refresh',
'year': 2010}
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN17555%27 HTTP/1.1" 200 None
2026-03-29 18:49:12 [auto1.de] INFO: Saving data for EN17555: {'auction_closing_time': 1774883250.0, 'created_time': 1774723632.221541, 'last_price_update_time': 1774810152.189993}
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN17555') HTTP/1.1" 204 0
2026-03-29 18:49:12 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN29475%27 HTTP/1.1" 200 None
2026-03-29 18:49:12 [auto1.de] INFO: Scrape type for HN29475: 2
2026-03-29 18:49:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475
2026-03-29 18:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306d745b-ac05-5f2c-a67f-64b41a8efc39 with scrape type 2
2026-03-29 18:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 306d745b-ac05-5f2c-a67f-64b41a8efc39 with scrape type 2
2026-03-29 18:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 306d745b-ac05-5f2c-a67f-64b41a8efc39, identifier: HN29475
2026-03-29 18:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475
2026-03-29 18:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475
2026-03-29 18:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 306d745b-ac05-5f2c-a67f-64b41a8efc39 with identifier: HN29475 to the API
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:36:53Z',
'fuel_type': 'petrol',
'id': '306d745b-ac05-5f2c-a67f-64b41a8efc39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN29475',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 162594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-12',
'seller_name': None,
'title': 'Dacia Logan MCV 1.6 LIVE II',
'transmission': 'manual',
'trim': 'LIVE II',
'year': 2012}
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN29475%27 HTTP/1.1" 200 None
2026-03-29 18:49:12 [auto1.de] INFO: Saving data for HN29475: {'auction_closing_time': 1774885013.0, 'created_time': 1774723594.12052, 'last_price_update_time': 1774810152.583922}
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN29475') HTTP/1.1" 204 0
2026-03-29 18:49:12 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6740 | hits on page: 40
2026-03-29 18:49:12 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY60901%27 HTTP/1.1" 200 None
2026-03-29 18:49:12 [auto1.de] INFO: Scrape type for UY60901: 2
2026-03-29 18:49:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901
2026-03-29 18:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3865c2e-3891-5656-982a-919ba8851b55 with scrape type 2
2026-03-29 18:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3865c2e-3891-5656-982a-919ba8851b55 with scrape type 2
2026-03-29 18:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3865c2e-3891-5656-982a-919ba8851b55, identifier: UY60901
2026-03-29 18:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901
2026-03-29 18:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901
2026-03-29 18:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3865c2e-3891-5656-982a-919ba8851b55 with identifier: UY60901 to the API
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:38Z',
'fuel_type': 'petrol',
'id': 'a3865c2e-3891-5656-982a-919ba8851b55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY60901',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 128762,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-30',
'seller_name': None,
'title': 'Mitsubishi Outlander 2.0 Instyle 4WD',
'transmission': 'automatic',
'trim': 'Instyle 4WD',
'year': 2014}
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY60901%27 HTTP/1.1" 200 None
2026-03-29 18:49:12 [auto1.de] INFO: Saving data for UY60901: {'auction_closing_time': 1774885598.0, 'created_time': 1774723510.527824, 'last_price_update_time': 1774810152.986768}
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY60901') HTTP/1.1" 204 0
2026-03-29 18:49:13 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-29 18:49:13 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-29 18:49:13 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50247%27 HTTP/1.1" 200 None
2026-03-29 18:49:13 [auto1.de] INFO: Scrape type for TH50247: 2
2026-03-29 18:49:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247
2026-03-29 18:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with scrape type 2
2026-03-29 18:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with scrape type 2
2026-03-29 18:49:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 592cbc29-5289-5a4c-a101-d4b11e0f14c7, identifier: TH50247
2026-03-29 18:49:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:49:13 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE81625%27 HTTP/1.1" 200 None
2026-03-29 18:49:13 [auto1.de] INFO: Scrape type for BE81625: 2
2026-03-29 18:49:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625
2026-03-29 18:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5199a5-1ebe-52b0-8ac9-992116b90421 with scrape type 2
2026-03-29 18:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae5199a5-1ebe-52b0-8ac9-992116b90421 with scrape type 2
2026-03-29 18:49:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5199a5-1ebe-52b0-8ac9-992116b90421, identifier: BE81625
2026-03-29 18:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247
2026-03-29 18:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247
2026-03-29 18:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 592cbc29-5289-5a4c-a101-d4b11e0f14c7 with identifier: TH50247 to the API
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:11:30Z',
'fuel_type': 'petrol',
'id': '592cbc29-5289-5a4c-a101-d4b11e0f14c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH50247',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 66762,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-05',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2020}
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50247%27 HTTP/1.1" 200 None
2026-03-29 18:49:13 [auto1.de] INFO: Saving data for TH50247: {'auction_closing_time': 1774883490.0, 'created_time': 1774035523.143112, 'last_price_update_time': 1774810153.710009}
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH50247') HTTP/1.1" 204 0
2026-03-29 18:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625
2026-03-29 18:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625
2026-03-29 18:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5199a5-1ebe-52b0-8ac9-992116b90421 with identifier: BE81625 to the API
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:10:55Z',
'fuel_type': 'diesel',
'id': 'ae5199a5-1ebe-52b0-8ac9-992116b90421',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE81625',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 184193,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-14',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE81625%27 HTTP/1.1" 200 None
2026-03-29 18:49:13 [auto1.de] INFO: Saving data for BE81625: {'auction_closing_time': 1774883455.0, 'created_time': 1774723512.571431, 'last_price_update_time': 1774810153.997335}
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE81625') HTTP/1.1" 204 0
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR61927%27 HTTP/1.1" 200 None
2026-03-29 18:49:14 [auto1.de] INFO: Scrape type for LR61927: 2
2026-03-29 18:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927
2026-03-29 18:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with scrape type 2
2026-03-29 18:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with scrape type 2
2026-03-29 18:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ef68d61-efa4-54e0-b308-8b263cf39bd2, identifier: LR61927
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-29 18:49:14 [auto1.de] INFO: Scrape type for GY94515: 2
2026-03-29 18:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515
2026-03-29 18:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with scrape type 2
2026-03-29 18:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with scrape type 2
2026-03-29 18:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca, identifier: GY94515
2026-03-29 18:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927
2026-03-29 18:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927
2026-03-29 18:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ef68d61-efa4-54e0-b308-8b263cf39bd2 with identifier: LR61927 to the API
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:06:45Z',
'fuel_type': 'diesel',
'id': '7ef68d61-efa4-54e0-b308-8b263cf39bd2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR61927',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 266641,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-18',
'seller_name': None,
'title': 'BMW 5er 530d xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2018}
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR61927%27 HTTP/1.1" 200 None
2026-03-29 18:49:14 [auto1.de] INFO: Saving data for LR61927: {'auction_closing_time': 1774883205.0, 'created_time': 1774723504.126781, 'last_price_update_time': 1774810154.510944}
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR61927') HTTP/1.1" 204 0
2026-03-29 18:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515
2026-03-29 18:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515
2026-03-29 18:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64d17e0a-8633-59c7-a3cc-8c31edaed6ca with identifier: GY94515 to the API
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:54Z',
'fuel_type': 'petrol',
'id': '64d17e0a-8633-59c7-a3cc-8c31edaed6ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY94515',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 59587,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-02',
'seller_name': None,
'title': 'Audi A4 35 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-29 18:49:14 [auto1.de] INFO: Saving data for GY94515: {'auction_closing_time': 1774883094.0, 'created_time': 1774723517.367865, 'last_price_update_time': 1774810154.881297}
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY94515') HTTP/1.1" 204 0
2026-03-29 18:49:14 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR38296%27 HTTP/1.1" 200 None
2026-03-29 18:49:14 [auto1.de] INFO: Scrape type for PR38296: 2
2026-03-29 18:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296
2026-03-29 18:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with scrape type 2
2026-03-29 18:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with scrape type 2
2026-03-29 18:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17068962-4b9a-5ab1-ac87-ee65fae2ba30, identifier: PR38296
2026-03-29 18:49:15 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM12575%27 HTTP/1.1" 200 None
2026-03-29 18:49:15 [auto1.de] INFO: Scrape type for LM12575: 2
2026-03-29 18:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575
2026-03-29 18:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 722f5647-615c-5667-9abd-4ffea2f2e371 with scrape type 2
2026-03-29 18:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 722f5647-615c-5667-9abd-4ffea2f2e371 with scrape type 2
2026-03-29 18:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 722f5647-615c-5667-9abd-4ffea2f2e371, identifier: LM12575
2026-03-29 18:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296
2026-03-29 18:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296
2026-03-29 18:49:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17068962-4b9a-5ab1-ac87-ee65fae2ba30 with identifier: PR38296 to the API
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:36:32Z',
'fuel_type': 'petrol',
'id': '17068962-4b9a-5ab1-ac87-ee65fae2ba30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR38296',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 10995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-10',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI Maxi',
'transmission': 'automatic',
'trim': 'Maxi',
'year': 2024}
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR38296%27 HTTP/1.1" 200 None
2026-03-29 18:49:15 [auto1.de] INFO: Saving data for PR38296: {'auction_closing_time': 1774884992.0, 'created_time': 1774034771.381207, 'last_price_update_time': 1774810155.391455}
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR38296') HTTP/1.1" 204 0
2026-03-29 18:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575
2026-03-29 18:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575
2026-03-29 18:49:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 722f5647-615c-5667-9abd-4ffea2f2e371 with identifier: LM12575 to the API
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:43:51Z',
'fuel_type': 'petrol',
'id': '722f5647-615c-5667-9abd-4ffea2f2e371',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM12575',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 72870,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-20',
'seller_name': None,
'title': 'Fiat Panda 1.2 Waze',
'transmission': 'manual',
'trim': 'Waze',
'year': 2018}
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM12575%27 HTTP/1.1" 200 None
2026-03-29 18:49:15 [auto1.de] INFO: Saving data for LM12575: {'auction_closing_time': 1774885431.0, 'created_time': 1774723527.962249, 'last_price_update_time': 1774810155.677493}
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM12575') HTTP/1.1" 204 0
2026-03-29 18:49:15 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30135%27 HTTP/1.1" 200 None
2026-03-29 18:49:15 [auto1.de] INFO: Scrape type for MN30135: 2
2026-03-29 18:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135
2026-03-29 18:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with scrape type 2
2026-03-29 18:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with scrape type 2
2026-03-29 18:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2, identifier: MN30135
2026-03-29 18:49:15 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-29 18:49:15 [auto1.de] INFO: Scrape type for CV44457: 2
2026-03-29 18:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457
2026-03-29 18:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a762c6e-42ea-5b31-a42c-234875b02206 with scrape type 2
2026-03-29 18:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a762c6e-42ea-5b31-a42c-234875b02206 with scrape type 2
2026-03-29 18:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a762c6e-42ea-5b31-a42c-234875b02206, identifier: CV44457
2026-03-29 18:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135
2026-03-29 18:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135
2026-03-29 18:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9c7e85a-099a-5974-88e1-a43d3a7ae8d2 with identifier: MN30135 to the API
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:17Z',
'fuel_type': 'petrol',
'id': 'b9c7e85a-099a-5974-88e1-a43d3a7ae8d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN30135',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 16629,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-30',
'seller_name': None,
'title': 'Volkswagen Beetle 1.4 TSI Design BlueMotion',
'transmission': 'automatic',
'trim': 'Design BlueMotion',
'year': 2018}
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30135%27 HTTP/1.1" 200 None
2026-03-29 18:49:16 [auto1.de] INFO: Saving data for MN30135: {'auction_closing_time': 1774884557.0, 'created_time': 1774723503.669623, 'last_price_update_time': 1774810156.202571}
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN30135') HTTP/1.1" 204 0
2026-03-29 18:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457
2026-03-29 18:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457
2026-03-29 18:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a762c6e-42ea-5b31-a42c-234875b02206 with identifier: CV44457 to the API
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:30:58Z',
'fuel_type': 'petrol',
'id': '2a762c6e-42ea-5b31-a42c-234875b02206',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV44457',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 125013,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-27',
'seller_name': None,
'title': 'Peugeot Rifter 1.2 PureTech Active L1',
'transmission': 'automatic',
'trim': 'Active L1',
'year': 2020}
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-29 18:49:16 [auto1.de] INFO: Saving data for CV44457: {'auction_closing_time': 1774884658.0, 'created_time': 1774723493.924409, 'last_price_update_time': 1774810156.483917}
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV44457') HTTP/1.1" 204 0
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV19830%27 HTTP/1.1" 200 None
2026-03-29 18:49:16 [auto1.de] INFO: Scrape type for YV19830: 2
2026-03-29 18:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830
2026-03-29 18:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with scrape type 2
2026-03-29 18:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with scrape type 2
2026-03-29 18:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03f0d89d-3e3c-5056-ae76-419bb3f40c74, identifier: YV19830
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-29 18:49:16 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23133%27 HTTP/1.1" 200 None
2026-03-29 18:49:16 [auto1.de] INFO: Scrape type for AZ23133: 2
2026-03-29 18:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133
2026-03-29 18:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490cda3f-5eff-58c2-9d2c-334e28fbf634 with scrape type 2
2026-03-29 18:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 490cda3f-5eff-58c2-9d2c-334e28fbf634 with scrape type 2
2026-03-29 18:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 490cda3f-5eff-58c2-9d2c-334e28fbf634, identifier: AZ23133
2026-03-29 18:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830
2026-03-29 18:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830
2026-03-29 18:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03f0d89d-3e3c-5056-ae76-419bb3f40c74 with identifier: YV19830 to the API
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:49:31Z',
'fuel_type': 'petrol',
'id': '03f0d89d-3e3c-5056-ae76-419bb3f40c74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV19830',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 101442,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-28',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2020}
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV19830%27 HTTP/1.1" 200 None
2026-03-29 18:49:16 [auto1.de] INFO: Saving data for YV19830: {'auction_closing_time': 1774885771.0, 'created_time': 1774032064.803309, 'last_price_update_time': 1774810156.98493}
2026-03-29 18:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV19830') HTTP/1.1" 204 0
2026-03-29 18:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133
2026-03-29 18:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133
2026-03-29 18:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 490cda3f-5eff-58c2-9d2c-334e28fbf634 with identifier: AZ23133 to the API
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:16:03Z',
'fuel_type': 'petrol',
'id': '490cda3f-5eff-58c2-9d2c-334e28fbf634',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ23133',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 34130,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-07',
'seller_name': None,
'title': 'Hyundai i20 1.0 T-GDI Mild-Hybrid Select',
'transmission': 'automatic',
'trim': 'Select',
'year': 2022}
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23133%27 HTTP/1.1" 200 None
2026-03-29 18:49:17 [auto1.de] INFO: Saving data for AZ23133: {'auction_closing_time': 1774883763.0, 'created_time': 1774723516.643974, 'last_price_update_time': 1774810157.384295}
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ23133') HTTP/1.1" 204 0
2026-03-29 18:49:17 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF95367%27 HTTP/1.1" 200 None
2026-03-29 18:49:17 [auto1.de] INFO: Scrape type for TF95367: 2
2026-03-29 18:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367
2026-03-29 18:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with scrape type 2
2026-03-29 18:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with scrape type 2
2026-03-29 18:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 099874d2-9d2e-5dc2-9ca4-9eaf13792307, identifier: TF95367
2026-03-29 18:49:17 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62286%27 HTTP/1.1" 200 None
2026-03-29 18:49:17 [auto1.de] INFO: Scrape type for XV62286: 2
2026-03-29 18:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286
2026-03-29 18:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03845dec-74cb-59b5-8e78-c2da3985b3db with scrape type 2
2026-03-29 18:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03845dec-74cb-59b5-8e78-c2da3985b3db with scrape type 2
2026-03-29 18:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03845dec-74cb-59b5-8e78-c2da3985b3db, identifier: XV62286
2026-03-29 18:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367
2026-03-29 18:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367
2026-03-29 18:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 099874d2-9d2e-5dc2-9ca4-9eaf13792307 with identifier: TF95367 to the API
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:29:59Z',
'fuel_type': 'diesel',
'id': '099874d2-9d2e-5dc2-9ca4-9eaf13792307',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF95367',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 290756,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-12',
'seller_name': None,
'title': 'Audi A6 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF95367%27 HTTP/1.1" 200 None
2026-03-29 18:49:17 [auto1.de] INFO: Saving data for TF95367: {'auction_closing_time': 1774884599.0, 'created_time': 1774723506.697036, 'last_price_update_time': 1774810157.9025}
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF95367') HTTP/1.1" 204 0
2026-03-29 18:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286
2026-03-29 18:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286
2026-03-29 18:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03845dec-74cb-59b5-8e78-c2da3985b3db with identifier: XV62286 to the API
2026-03-29 18:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:36:46Z',
'fuel_type': 'petrol',
'id': '03845dec-74cb-59b5-8e78-c2da3985b3db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV62286',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 170454,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-20',
'seller_name': None,
'title': 'BMW 1er 116i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2016}
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62286%27 HTTP/1.1" 200 None
2026-03-29 18:49:19 [auto1.de] INFO: Saving data for XV62286: {'auction_closing_time': 1774885006.0, 'created_time': 1774034791.776865, 'last_price_update_time': 1774810159.092021}
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV62286') HTTP/1.1" 204 0
2026-03-29 18:49:19 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-29 18:49:19 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87104%27 HTTP/1.1" 200 None
2026-03-29 18:49:19 [auto1.de] INFO: Scrape type for WE87104: 2
2026-03-29 18:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104
2026-03-29 18:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with scrape type 2
2026-03-29 18:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with scrape type 2
2026-03-29 18:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4a4b41a-385a-5f1d-bb74-c4fd73beff06, identifier: WE87104
2026-03-29 18:49:19 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47010%27 HTTP/1.1" 200 None
2026-03-29 18:49:19 [auto1.de] INFO: Scrape type for ZS47010: 2
2026-03-29 18:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010
2026-03-29 18:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9d9cc51-fd6a-5005-8364-84446c8238f7 with scrape type 2
2026-03-29 18:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9d9cc51-fd6a-5005-8364-84446c8238f7 with scrape type 2
2026-03-29 18:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9d9cc51-fd6a-5005-8364-84446c8238f7, identifier: ZS47010
2026-03-29 18:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104
2026-03-29 18:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104
2026-03-29 18:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4a4b41a-385a-5f1d-bb74-c4fd73beff06 with identifier: WE87104 to the API
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:28:38Z',
'fuel_type': 'petrol',
'id': 'd4a4b41a-385a-5f1d-bb74-c4fd73beff06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE87104',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 181007,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-25',
'seller_name': None,
'title': 'Audi A5 3.0 V6 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87104%27 HTTP/1.1" 200 None
2026-03-29 18:49:19 [auto1.de] INFO: Saving data for WE87104: {'auction_closing_time': 1774884518.0, 'created_time': 1774118783.041569, 'last_price_update_time': 1774810159.606578}
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE87104') HTTP/1.1" 204 0
2026-03-29 18:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010
2026-03-29 18:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010
2026-03-29 18:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9d9cc51-fd6a-5005-8364-84446c8238f7 with identifier: ZS47010 to the API
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:22:35Z',
'fuel_type': 'petrol',
'id': 'e9d9cc51-fd6a-5005-8364-84446c8238f7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS47010',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 21315,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-05',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI R 20 Years 4Motion',
'transmission': 'automatic',
'trim': 'R 20 Years 4Motion',
'year': 2023}
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47010%27 HTTP/1.1" 200 None
2026-03-29 18:49:19 [auto1.de] INFO: Saving data for ZS47010: {'auction_closing_time': 1774884155.0, 'created_time': 1774350360.68977, 'last_price_update_time': 1774810159.895756}
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS47010') HTTP/1.1" 204 0
2026-03-29 18:49:19 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-29 18:49:19 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-29 18:49:19 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-29 18:49:19 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC98449%27 HTTP/1.1" 200 None
2026-03-29 18:49:19 [auto1.de] INFO: Scrape type for YC98449: 2
2026-03-29 18:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449
2026-03-29 18:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with scrape type 2
2026-03-29 18:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with scrape type 2
2026-03-29 18:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4, identifier: YC98449
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-29 18:49:20 [auto1.de] INFO: Scrape type for FX61417: 2
2026-03-29 18:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417
2026-03-29 18:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fabdf982-017c-5aae-96c8-a83a54311941 with scrape type 2
2026-03-29 18:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fabdf982-017c-5aae-96c8-a83a54311941 with scrape type 2
2026-03-29 18:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fabdf982-017c-5aae-96c8-a83a54311941, identifier: FX61417
2026-03-29 18:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449
2026-03-29 18:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449
2026-03-29 18:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b473a1e2-87c0-5b4e-b02b-2bdcc161edc4 with identifier: YC98449 to the API
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:09:13Z',
'fuel_type': 'petrol',
'id': 'b473a1e2-87c0-5b4e-b02b-2bdcc161edc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC98449',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 237389,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-26',
'seller_name': None,
'title': 'Volkswagen Touran 1.6 Conceptline',
'transmission': 'manual',
'trim': 'Conceptline',
'year': 2009}
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC98449%27 HTTP/1.1" 200 None
2026-03-29 18:49:20 [auto1.de] INFO: Saving data for YC98449: {'auction_closing_time': 1774883353.0, 'created_time': 1774723535.332573, 'last_price_update_time': 1774810160.414873}
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC98449') HTTP/1.1" 204 0
2026-03-29 18:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417
2026-03-29 18:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417
2026-03-29 18:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fabdf982-017c-5aae-96c8-a83a54311941 with identifier: FX61417 to the API
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:27:30Z',
'fuel_type': 'petrol',
'id': 'fabdf982-017c-5aae-96c8-a83a54311941',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX61417',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 153832,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-16',
'seller_name': None,
'title': 'Skoda Fabia 1.4 Style Edition',
'transmission': 'manual',
'trim': 'Style Edition',
'year': 2009}
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-29 18:49:20 [auto1.de] INFO: Saving data for FX61417: {'auction_closing_time': 1774884450.0, 'created_time': 1774723553.561912, 'last_price_update_time': 1774810160.785901}
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX61417') HTTP/1.1" 204 0
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD69831%27 HTTP/1.1" 200 None
2026-03-29 18:49:20 [auto1.de] INFO: Scrape type for KD69831: 2
2026-03-29 18:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831
2026-03-29 18:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a with scrape type 2
2026-03-29 18:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2afa2b31-3a15-567a-9846-ee6f74b02f7a with scrape type 2
2026-03-29 18:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2afa2b31-3a15-567a-9846-ee6f74b02f7a, identifier: KD69831
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-29 18:49:20 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-29 18:49:20 [auto1.de] INFO: Scrape type for ZG89267: 2
2026-03-29 18:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267
2026-03-29 18:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with scrape type 2
2026-03-29 18:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with scrape type 2
2026-03-29 18:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 009fc4ab-bac0-5afd-be37-5b5b42a431d4, identifier: ZG89267
2026-03-29 18:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831
2026-03-29 18:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831
2026-03-29 18:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2afa2b31-3a15-567a-9846-ee6f74b02f7a with identifier: KD69831 to the API
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:57:02Z',
'fuel_type': 'petrol',
'id': '2afa2b31-3a15-567a-9846-ee6f74b02f7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD69831',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 284070,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-11',
'seller_name': None,
'title': 'Volkswagen Golf V 2.0 TFSI GTI',
'transmission': 'automatic',
'trim': 'GTI',
'year': 2005}
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD69831%27 HTTP/1.1" 200 None
2026-03-29 18:49:21 [auto1.de] INFO: Saving data for KD69831: {'auction_closing_time': 1774886222.0, 'created_time': 1774723524.0761, 'last_price_update_time': 1774810161.293672}
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD69831') HTTP/1.1" 204 0
2026-03-29 18:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267
2026-03-29 18:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267
2026-03-29 18:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 009fc4ab-bac0-5afd-be37-5b5b42a431d4 with identifier: ZG89267 to the API
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 158,
'expiration_date': '2026-03-30T15:02:30Z',
'fuel_type': 'petrol',
'id': '009fc4ab-bac0-5afd-be37-5b5b42a431d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG89267',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 20496,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-19',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2021}
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-29 18:49:21 [auto1.de] INFO: Saving data for ZG89267: {'auction_closing_time': 1774882950.0, 'created_time': 1774035765.917704, 'last_price_update_time': 1774810161.580009}
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG89267') HTTP/1.1" 204 0
2026-03-29 18:49:21 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-29 18:49:21 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-29 18:49:21 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE71263%27 HTTP/1.1" 200 None
2026-03-29 18:49:21 [auto1.de] INFO: Scrape type for YE71263: 2
2026-03-29 18:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263
2026-03-29 18:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with scrape type 2
2026-03-29 18:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with scrape type 2
2026-03-29 18:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8, identifier: YE71263
2026-03-29 18:49:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:21 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30345%27 HTTP/1.1" 200 None
2026-03-29 18:49:21 [auto1.de] INFO: Scrape type for WW30345: 2
2026-03-29 18:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345
2026-03-29 18:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8013093d-1580-5701-b07f-5bcbda13b8c9 with scrape type 2
2026-03-29 18:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8013093d-1580-5701-b07f-5bcbda13b8c9 with scrape type 2
2026-03-29 18:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8013093d-1580-5701-b07f-5bcbda13b8c9, identifier: WW30345
2026-03-29 18:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263
2026-03-29 18:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263
2026-03-29 18:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8 with identifier: YE71263 to the API
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:29:17Z',
'fuel_type': 'diesel',
'id': 'eb8a1c5f-ebad-5895-b13a-34ebe8a9f8c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE71263',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 291567,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-20',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2013}
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE71263%27 HTTP/1.1" 200 None
2026-03-29 18:49:22 [auto1.de] INFO: Saving data for YE71263: {'auction_closing_time': 1774884557.0, 'created_time': 1774723508.289231, 'last_price_update_time': 1774810162.104906}
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE71263') HTTP/1.1" 204 0
2026-03-29 18:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345
2026-03-29 18:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345
2026-03-29 18:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8013093d-1580-5701-b07f-5bcbda13b8c9 with identifier: WW30345 to the API
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:23:40Z',
'fuel_type': 'diesel',
'id': '8013093d-1580-5701-b07f-5bcbda13b8c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW30345',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 442990,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-08',
'seller_name': None,
'title': 'Audi A6 2.5 V6 TDI',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30345%27 HTTP/1.1" 200 None
2026-03-29 18:49:22 [auto1.de] INFO: Saving data for WW30345: {'auction_closing_time': 1774884220.0, 'created_time': 1774723637.388471, 'last_price_update_time': 1774810162.481497}
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW30345') HTTP/1.1" 204 0
2026-03-29 18:49:22 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW03502%27 HTTP/1.1" 200 None
2026-03-29 18:49:22 [auto1.de] INFO: Scrape type for PW03502: 2
2026-03-29 18:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502
2026-03-29 18:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be2fc2b-ef65-598a-b337-31a15295c10d with scrape type 2
2026-03-29 18:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2be2fc2b-ef65-598a-b337-31a15295c10d with scrape type 2
2026-03-29 18:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2be2fc2b-ef65-598a-b337-31a15295c10d, identifier: PW03502
2026-03-29 18:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502
2026-03-29 18:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502
2026-03-29 18:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2be2fc2b-ef65-598a-b337-31a15295c10d with identifier: PW03502 to the API
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:15:12Z',
'fuel_type': 'diesel',
'id': '2be2fc2b-ef65-598a-b337-31a15295c10d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW03502',
'listing': 'auction',
'make': 'BMW',
'model': '7er',
'odometer': 103729,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-24',
'seller_name': None,
'title': 'BMW 7er 740d Mild-Hybrid xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2023}
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW03502%27 HTTP/1.1" 200 None
2026-03-29 18:49:22 [auto1.de] INFO: Saving data for PW03502: {'auction_closing_time': 1774883712.0, 'created_time': 1774723514.421453, 'last_price_update_time': 1774810162.868856}
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW03502') HTTP/1.1" 204 0
2026-03-29 18:49:22 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-29 18:49:22 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90544%27 HTTP/1.1" 200 None
2026-03-29 18:49:22 [auto1.de] INFO: Scrape type for TZ90544: 2
2026-03-29 18:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544
2026-03-29 18:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 064bc42b-c995-5dd4-92a4-4cce0eb30571 with scrape type 2
2026-03-29 18:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 064bc42b-c995-5dd4-92a4-4cce0eb30571 with scrape type 2
2026-03-29 18:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 064bc42b-c995-5dd4-92a4-4cce0eb30571, identifier: TZ90544
2026-03-29 18:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544
2026-03-29 18:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544
2026-03-29 18:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 064bc42b-c995-5dd4-92a4-4cce0eb30571 with identifier: TZ90544 to the API
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:58:19Z',
'fuel_type': 'petrol',
'id': '064bc42b-c995-5dd4-92a4-4cce0eb30571',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ90544',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 136097,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-26',
'seller_name': None,
'title': 'Mazda 5 1.8 Center-Line',
'transmission': 'manual',
'trim': 'Center-Line',
'year': 2012}
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90544%27 HTTP/1.1" 200 None
2026-03-29 18:49:23 [auto1.de] INFO: Saving data for TZ90544: {'auction_closing_time': 1774886299.0, 'created_time': 1774723492.120116, 'last_price_update_time': 1774810163.262348}
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ90544') HTTP/1.1" 204 0
2026-03-29 18:49:23 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6740 | hits on page: 40
2026-03-29 18:49:23 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-29 18:49:23 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-29 18:49:23 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-29 18:49:23 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-29 18:49:23 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00937%27 HTTP/1.1" 200 None
2026-03-29 18:49:23 [auto1.de] INFO: Scrape type for BU00937: 2
2026-03-29 18:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937
2026-03-29 18:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b128df5a-33a7-5868-869e-85c745ee281e with scrape type 2
2026-03-29 18:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b128df5a-33a7-5868-869e-85c745ee281e with scrape type 2
2026-03-29 18:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b128df5a-33a7-5868-869e-85c745ee281e, identifier: BU00937
2026-03-29 18:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937
2026-03-29 18:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937
2026-03-29 18:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b128df5a-33a7-5868-869e-85c745ee281e with identifier: BU00937 to the API
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:54:25Z',
'fuel_type': 'diesel',
'id': 'b128df5a-33a7-5868-869e-85c745ee281e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU00937',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 188119,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-22',
'seller_name': None,
'title': 'Peugeot 207 1.6 HDi 99G',
'transmission': 'manual',
'trim': '99G',
'year': 2010}
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00937%27 HTTP/1.1" 200 None
2026-03-29 18:49:23 [auto1.de] INFO: Saving data for BU00937: {'auction_closing_time': 1774886065.0, 'created_time': 1774034663.183864, 'last_price_update_time': 1774810163.661965}
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU00937') HTTP/1.1" 204 0
2026-03-29 18:49:23 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39619%27 HTTP/1.1" 200 None
2026-03-29 18:49:23 [auto1.de] INFO: Scrape type for SC39619: 2
2026-03-29 18:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619
2026-03-29 18:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc03520f-1607-53a6-a31c-008677adb290 with scrape type 2
2026-03-29 18:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc03520f-1607-53a6-a31c-008677adb290 with scrape type 2
2026-03-29 18:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc03520f-1607-53a6-a31c-008677adb290, identifier: SC39619
2026-03-29 18:49:23 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB58662%27 HTTP/1.1" 200 None
2026-03-29 18:49:23 [auto1.de] INFO: Scrape type for CB58662: 2
2026-03-29 18:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662
2026-03-29 18:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fa8b7b5-e78f-516c-8dde-c54186f576df with scrape type 2
2026-03-29 18:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fa8b7b5-e78f-516c-8dde-c54186f576df with scrape type 2
2026-03-29 18:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fa8b7b5-e78f-516c-8dde-c54186f576df, identifier: CB58662
2026-03-29 18:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619
2026-03-29 18:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619
2026-03-29 18:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc03520f-1607-53a6-a31c-008677adb290 with identifier: SC39619 to the API
2026-03-29 18:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:37:15Z',
'fuel_type': 'petrol',
'id': 'fc03520f-1607-53a6-a31c-008677adb290',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC39619',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 172638,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-30',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39619%27 HTTP/1.1" 200 None
2026-03-29 18:49:24 [auto1.de] INFO: Saving data for SC39619: {'auction_closing_time': 1774885035.0, 'created_time': 1774723530.872395, 'last_price_update_time': 1774810164.173312}
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC39619') HTTP/1.1" 204 0
2026-03-29 18:49:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662
2026-03-29 18:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662
2026-03-29 18:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fa8b7b5-e78f-516c-8dde-c54186f576df with identifier: CB58662 to the API
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:05Z',
'fuel_type': 'diesel',
'id': '1fa8b7b5-e78f-516c-8dde-c54186f576df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB58662',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 202054,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-12',
'seller_name': None,
'title': 'Seat Leon 2.0 TDI Xcellence',
'transmission': 'automatic',
'trim': 'Xcellence',
'year': 2017}
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB58662%27 HTTP/1.1" 200 None
2026-03-29 18:49:24 [auto1.de] INFO: Saving data for CB58662: {'auction_closing_time': 1774885565.0, 'created_time': 1774723487.081927, 'last_price_update_time': 1774810164.462866}
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB58662') HTTP/1.1" 204 0
2026-03-29 18:49:24 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-29 18:49:24 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW03364%27 HTTP/1.1" 200 None
2026-03-29 18:49:24 [auto1.de] INFO: Scrape type for VW03364: 2
2026-03-29 18:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364
2026-03-29 18:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with scrape type 2
2026-03-29 18:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with scrape type 2
2026-03-29 18:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9, identifier: VW03364
2026-03-29 18:49:24 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN13628%27 HTTP/1.1" 200 None
2026-03-29 18:49:24 [auto1.de] INFO: Scrape type for WN13628: 2
2026-03-29 18:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628
2026-03-29 18:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with scrape type 2
2026-03-29 18:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with scrape type 2
2026-03-29 18:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae, identifier: WN13628
2026-03-29 18:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364
2026-03-29 18:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364
2026-03-29 18:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19253ffb-d3e1-5362-80bd-b80b9ffa47f9 with identifier: VW03364 to the API
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:30:44Z',
'fuel_type': 'diesel',
'id': '19253ffb-d3e1-5362-80bd-b80b9ffa47f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW03364',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 260047,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-13',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW03364%27 HTTP/1.1" 200 None
2026-03-29 18:49:24 [auto1.de] INFO: Saving data for VW03364: {'auction_closing_time': 1774884644.0, 'created_time': 1774089472.869277, 'last_price_update_time': 1774810164.984763}
2026-03-29 18:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW03364') HTTP/1.1" 204 0
2026-03-29 18:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628
2026-03-29 18:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628
2026-03-29 18:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21e09935-c3aa-5c50-ac50-ff052f4fd5ae with identifier: WN13628 to the API
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:08:57Z',
'fuel_type': 'petrol',
'id': '21e09935-c3aa-5c50-ac50-ff052f4fd5ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN13628',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 84821,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-26',
'seller_name': None,
'title': 'Skoda Octavia 2.0 TSI RS 245',
'transmission': 'automatic',
'trim': 'RS 245',
'year': 2019}
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN13628%27 HTTP/1.1" 200 None
2026-03-29 18:49:25 [auto1.de] INFO: Saving data for WN13628: {'auction_closing_time': 1774883337.0, 'created_time': 1774350310.473324, 'last_price_update_time': 1774810165.36445}
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN13628') HTTP/1.1" 204 0
2026-03-29 18:49:25 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN85056%27 HTTP/1.1" 200 None
2026-03-29 18:49:25 [auto1.de] INFO: Scrape type for DN85056: 2
2026-03-29 18:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056
2026-03-29 18:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3547840c-581b-5de6-9e40-95ddef174f8d with scrape type 2
2026-03-29 18:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3547840c-581b-5de6-9e40-95ddef174f8d with scrape type 2
2026-03-29 18:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3547840c-581b-5de6-9e40-95ddef174f8d, identifier: DN85056
2026-03-29 18:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056
2026-03-29 18:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056
2026-03-29 18:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3547840c-581b-5de6-9e40-95ddef174f8d with identifier: DN85056 to the API
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:29:34Z',
'fuel_type': 'petrol',
'id': '3547840c-581b-5de6-9e40-95ddef174f8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN85056',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 141318,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-11',
'seller_name': None,
'title': 'BMW 2er 218i Active Tourer Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2015}
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN85056%27 HTTP/1.1" 200 None
2026-03-29 18:49:25 [auto1.de] INFO: Saving data for DN85056: {'auction_closing_time': 1774884574.0, 'created_time': 1774723500.869488, 'last_price_update_time': 1774810165.757211}
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN85056') HTTP/1.1" 204 0
2026-03-29 18:49:25 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-29 18:49:25 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV10415%27 HTTP/1.1" 200 None
2026-03-29 18:49:25 [auto1.de] INFO: Scrape type for KV10415: 2
2026-03-29 18:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-03-29 18:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f with scrape type 2
2026-03-29 18:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a54a8d50-57a9-5560-8e0b-7c12214f2c1f with scrape type 2
2026-03-29 18:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a54a8d50-57a9-5560-8e0b-7c12214f2c1f, identifier: KV10415
2026-03-29 18:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-03-29 18:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415
2026-03-29 18:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a54a8d50-57a9-5560-8e0b-7c12214f2c1f with identifier: KV10415 to the API
2026-03-29 18:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 450,
'expiration_date': '2026-03-30T15:19:48Z',
'fuel_type': 'petrol',
'id': 'a54a8d50-57a9-5560-8e0b-7c12214f2c1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV10415',
'listing': 'auction',
'make': 'Audi',
'model': 'RS 5',
'odometer': 110580,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-20',
'seller_name': None,
'title': 'Audi RS 5 4.2 V8 FSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2010}
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV10415%27 HTTP/1.1" 200 None
2026-03-29 18:49:26 [auto1.de] INFO: Saving data for KV10415: {'auction_closing_time': 1774883988.0, 'created_time': 1774723546.716694, 'last_price_update_time': 1774810166.142718}
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV10415') HTTP/1.1" 204 0
2026-03-29 18:49:26 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF76682%27 HTTP/1.1" 200 None
2026-03-29 18:49:26 [auto1.de] INFO: Scrape type for SF76682: 2
2026-03-29 18:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682
2026-03-29 18:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d329d3d4-ab4b-5315-863d-c0b306597e15 with scrape type 2
2026-03-29 18:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d329d3d4-ab4b-5315-863d-c0b306597e15 with scrape type 2
2026-03-29 18:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d329d3d4-ab4b-5315-863d-c0b306597e15, identifier: SF76682
2026-03-29 18:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682
2026-03-29 18:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682
2026-03-29 18:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d329d3d4-ab4b-5315-863d-c0b306597e15 with identifier: SF76682 to the API
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:23:51Z',
'fuel_type': 'petrol',
'id': 'd329d3d4-ab4b-5315-863d-c0b306597e15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF76682',
'listing': 'auction',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 128433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-01',
'seller_name': None,
'title': "Kia pro_cee'd 1.6 GDI Edition 7",
'transmission': 'manual',
'trim': 'Edition 7',
'year': 2013}
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF76682%27 HTTP/1.1" 200 None
2026-03-29 18:49:26 [auto1.de] INFO: Saving data for SF76682: {'auction_closing_time': 1774884231.0, 'created_time': 1774118987.313037, 'last_price_update_time': 1774810166.548465}
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF76682') HTTP/1.1" 204 0
2026-03-29 18:49:26 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE35567%27 HTTP/1.1" 200 None
2026-03-29 18:49:26 [auto1.de] INFO: Scrape type for CE35567: 2
2026-03-29 18:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567
2026-03-29 18:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6380c7-4986-5799-a904-6292c01fdbda with scrape type 2
2026-03-29 18:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6380c7-4986-5799-a904-6292c01fdbda with scrape type 2
2026-03-29 18:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6380c7-4986-5799-a904-6292c01fdbda, identifier: CE35567
2026-03-29 18:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567
2026-03-29 18:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567
2026-03-29 18:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6380c7-4986-5799-a904-6292c01fdbda with identifier: CE35567 to the API
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-30T15:08:27Z',
'fuel_type': 'petrol',
'id': '8d6380c7-4986-5799-a904-6292c01fdbda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE35567',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 217994,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-12',
'seller_name': None,
'title': 'BMW 3er 328i',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE35567%27 HTTP/1.1" 200 None
2026-03-29 18:49:26 [auto1.de] INFO: Saving data for CE35567: {'auction_closing_time': 1774883307.0, 'created_time': 1773428269.953947, 'last_price_update_time': 1774810166.947394}
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE35567') HTTP/1.1" 204 0
2026-03-29 18:49:26 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC92138%27 HTTP/1.1" 200 None
2026-03-29 18:49:26 [auto1.de] INFO: Scrape type for EC92138: 2
2026-03-29 18:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138
2026-03-29 18:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with scrape type 2
2026-03-29 18:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with scrape type 2
2026-03-29 18:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3, identifier: EC92138
2026-03-29 18:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138
2026-03-29 18:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138
2026-03-29 18:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 445ea4df-4e5f-5af7-bbf4-d142ba7f80e3 with identifier: EC92138 to the API
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:33:20Z',
'fuel_type': 'petrol',
'id': '445ea4df-4e5f-5af7-bbf4-d142ba7f80e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC92138',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 83614,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-01',
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2023}
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC92138%27 HTTP/1.1" 200 None
2026-03-29 18:49:27 [auto1.de] INFO: Saving data for EC92138: {'auction_closing_time': 1774884800.0, 'created_time': 1774723488.080194, 'last_price_update_time': 1774810167.35494}
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC92138') HTTP/1.1" 204 0
2026-03-29 18:49:27 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02934%27 HTTP/1.1" 200 None
2026-03-29 18:49:27 [auto1.de] INFO: Scrape type for RN02934: 2
2026-03-29 18:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934
2026-03-29 18:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with scrape type 2
2026-03-29 18:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with scrape type 2
2026-03-29 18:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c, identifier: RN02934
2026-03-29 18:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934
2026-03-29 18:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934
2026-03-29 18:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c with identifier: RN02934 to the API
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:00:17Z',
'fuel_type': 'diesel',
'id': '6f7f1b61-d56d-5a20-b3ca-3d22db81fa4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN02934',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 156120,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-11',
'seller_name': None,
'title': 'Audi A6 3.0 V6 TDI clean diesel',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02934%27 HTTP/1.1" 200 None
2026-03-29 18:49:27 [auto1.de] INFO: Saving data for RN02934: {'auction_closing_time': 1774882817.0, 'created_time': 1774723499.610726, 'last_price_update_time': 1774810167.753712}
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN02934') HTTP/1.1" 204 0
2026-03-29 18:49:27 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY39264%27 HTTP/1.1" 200 None
2026-03-29 18:49:27 [auto1.de] INFO: Scrape type for UY39264: 2
2026-03-29 18:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264
2026-03-29 18:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with scrape type 2
2026-03-29 18:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with scrape type 2
2026-03-29 18:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa, identifier: UY39264
2026-03-29 18:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264
2026-03-29 18:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264
2026-03-29 18:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa with identifier: UY39264 to the API
2026-03-29 18:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:24:58Z',
'fuel_type': 'petrol',
'id': '2b3e6aed-f2c4-5fb6-bacf-5d85266db4aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY39264',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 124797,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-09-16',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 160 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2010}
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY39264%27 HTTP/1.1" 200 None
2026-03-29 18:49:28 [auto1.de] INFO: Saving data for UY39264: {'auction_closing_time': 1774884298.0, 'created_time': 1774723496.590063, 'last_price_update_time': 1774810168.161222}
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY39264') HTTP/1.1" 204 0
2026-03-29 18:49:28 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-29 18:49:28 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59163%27 HTTP/1.1" 200 None
2026-03-29 18:49:28 [auto1.de] INFO: Scrape type for VL59163: 2
2026-03-29 18:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163
2026-03-29 18:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c9230a2-571c-5320-870a-63cd67096ff9 with scrape type 2
2026-03-29 18:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c9230a2-571c-5320-870a-63cd67096ff9 with scrape type 2
2026-03-29 18:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c9230a2-571c-5320-870a-63cd67096ff9, identifier: VL59163
2026-03-29 18:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163
2026-03-29 18:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163
2026-03-29 18:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c9230a2-571c-5320-870a-63cd67096ff9 with identifier: VL59163 to the API
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 144,
'expiration_date': '2026-03-30T15:26:21Z',
'fuel_type': 'diesel',
'id': '6c9230a2-571c-5320-870a-63cd67096ff9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL59163',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Life',
'odometer': 62180,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-09',
'seller_name': None,
'title': 'Opel Zafira Life 2.0 Diesel Tourer M (L2)',
'transmission': 'manual',
'trim': 'Tourer M (L2)',
'year': 2021}
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59163%27 HTTP/1.1" 200 None
2026-03-29 18:49:28 [auto1.de] INFO: Saving data for VL59163: {'auction_closing_time': 1774884381.0, 'created_time': 1774723498.008537, 'last_price_update_time': 1774810168.554152}
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL59163') HTTP/1.1" 204 0
2026-03-29 18:49:28 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH54106%27 HTTP/1.1" 200 None
2026-03-29 18:49:28 [auto1.de] INFO: Scrape type for AH54106: 2
2026-03-29 18:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106
2026-03-29 18:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a0dbcb-feb7-538a-b7ee-f3763978a16f with scrape type 2
2026-03-29 18:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4a0dbcb-feb7-538a-b7ee-f3763978a16f with scrape type 2
2026-03-29 18:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4a0dbcb-feb7-538a-b7ee-f3763978a16f, identifier: AH54106
2026-03-29 18:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106
2026-03-29 18:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106
2026-03-29 18:49:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4a0dbcb-feb7-538a-b7ee-f3763978a16f with identifier: AH54106 to the API
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:01:41Z',
'fuel_type': 'diesel',
'id': 'b4a0dbcb-feb7-538a-b7ee-f3763978a16f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH54106',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 169901,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-06-25',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH54106%27 HTTP/1.1" 200 None
2026-03-29 18:49:28 [auto1.de] INFO: Saving data for AH54106: {'auction_closing_time': 1774882901.0, 'created_time': 1774034126.898787, 'last_price_update_time': 1774810168.961876}
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH54106') HTTP/1.1" 204 0
2026-03-29 18:49:29 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6740 | hits on page: 40
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62882%27 HTTP/1.1" 200 None
2026-03-29 18:49:29 [auto1.de] INFO: Scrape type for KB62882: 2
2026-03-29 18:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882
2026-03-29 18:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db344b49-748a-5151-a673-ec3f6933eac1 with scrape type 2
2026-03-29 18:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db344b49-748a-5151-a673-ec3f6933eac1 with scrape type 2
2026-03-29 18:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db344b49-748a-5151-a673-ec3f6933eac1, identifier: KB62882
2026-03-29 18:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882
2026-03-29 18:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882
2026-03-29 18:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db344b49-748a-5151-a673-ec3f6933eac1 with identifier: KB62882 to the API
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:47:17Z',
'fuel_type': 'petrol',
'id': 'db344b49-748a-5151-a673-ec3f6933eac1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB62882',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 22742,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-04',
'seller_name': None,
'title': 'Opel Corsa 1.4 Navi',
'transmission': 'automatic',
'trim': 'Navi',
'year': 2012}
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62882%27 HTTP/1.1" 200 None
2026-03-29 18:49:29 [auto1.de] INFO: Saving data for KB62882: {'auction_closing_time': 1774885637.0, 'created_time': 1774723494.778879, 'last_price_update_time': 1774810169.453873}
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62882') HTTP/1.1" 204 0
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64298%27 HTTP/1.1" 200 None
2026-03-29 18:49:29 [auto1.de] INFO: Scrape type for XA64298: 2
2026-03-29 18:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298
2026-03-29 18:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 129d7b1c-9329-5e37-a7da-2bf4df575151 with scrape type 2
2026-03-29 18:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 129d7b1c-9329-5e37-a7da-2bf4df575151 with scrape type 2
2026-03-29 18:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 129d7b1c-9329-5e37-a7da-2bf4df575151, identifier: XA64298
2026-03-29 18:49:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-29 18:49:29 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82336%27 HTTP/1.1" 200 None
2026-03-29 18:49:29 [auto1.de] INFO: Scrape type for RX82336: 2
2026-03-29 18:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336
2026-03-29 18:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 543adbdb-a892-5452-8308-8c50f14bfe76 with scrape type 2
2026-03-29 18:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 543adbdb-a892-5452-8308-8c50f14bfe76 with scrape type 2
2026-03-29 18:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 543adbdb-a892-5452-8308-8c50f14bfe76, identifier: RX82336
2026-03-29 18:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298
2026-03-29 18:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298
2026-03-29 18:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 129d7b1c-9329-5e37-a7da-2bf4df575151 with identifier: XA64298 to the API
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:13:34Z',
'fuel_type': 'petrol',
'id': '129d7b1c-9329-5e37-a7da-2bf4df575151',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA64298',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 139811,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-17',
'seller_name': None,
'title': 'Opel Corsa 1.2 Graphite',
'transmission': 'manual',
'trim': 'Graphite',
'year': 2014}
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64298%27 HTTP/1.1" 200 None
2026-03-29 18:49:29 [auto1.de] INFO: Saving data for XA64298: {'auction_closing_time': 1774883614.0, 'created_time': 1774723510.91576, 'last_price_update_time': 1774810169.988485}
2026-03-29 18:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA64298') HTTP/1.1" 204 0
2026-03-29 18:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336
2026-03-29 18:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336
2026-03-29 18:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 543adbdb-a892-5452-8308-8c50f14bfe76 with identifier: RX82336 to the API
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:41:01Z',
'fuel_type': 'petrol',
'id': '543adbdb-a892-5452-8308-8c50f14bfe76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX82336',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 228162,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-08',
'seller_name': None,
'title': 'Opel Astra 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82336%27 HTTP/1.1" 200 None
2026-03-29 18:49:30 [auto1.de] INFO: Saving data for RX82336: {'auction_closing_time': 1774885261.0, 'created_time': 1774723611.446621, 'last_price_update_time': 1774810170.29176}
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX82336') HTTP/1.1" 204 0
2026-03-29 18:49:30 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU18032%27 HTTP/1.1" 200 None
2026-03-29 18:49:30 [auto1.de] INFO: Scrape type for FU18032: 2
2026-03-29 18:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032
2026-03-29 18:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with scrape type 2
2026-03-29 18:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with scrape type 2
2026-03-29 18:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce, identifier: FU18032
2026-03-29 18:49:30 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-29 18:49:30 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE07703%27 HTTP/1.1" 200 None
2026-03-29 18:49:30 [auto1.de] INFO: Scrape type for KE07703: 2
2026-03-29 18:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703
2026-03-29 18:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with scrape type 2
2026-03-29 18:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with scrape type 2
2026-03-29 18:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6, identifier: KE07703
2026-03-29 18:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032
2026-03-29 18:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032
2026-03-29 18:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dc6c98d-7bd1-550b-8ded-2524d7f85bce with identifier: FU18032 to the API
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:12:34Z',
'fuel_type': 'diesel',
'id': '0dc6c98d-7bd1-550b-8ded-2524d7f85bce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU18032',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 118846,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-05',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Life BlueMotion Tech',
'transmission': 'manual',
'trim': 'Life BlueMotion Tech',
'year': 2013}
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU18032%27 HTTP/1.1" 200 None
2026-03-29 18:49:30 [auto1.de] INFO: Saving data for FU18032: {'auction_closing_time': 1774883554.0, 'created_time': 1774723509.165359, 'last_price_update_time': 1774810170.805694}
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU18032') HTTP/1.1" 204 0
2026-03-29 18:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703
2026-03-29 18:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703
2026-03-29 18:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1bcd5b1-8690-5a8d-acfe-b737031f1bd6 with identifier: KE07703 to the API
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 286,
'expiration_date': '2026-03-30T15:01:31Z',
'fuel_type': 'diesel',
'id': 'a1bcd5b1-8690-5a8d-acfe-b737031f1bd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE07703',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 125848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-25',
'seller_name': None,
'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE07703%27 HTTP/1.1" 200 None
2026-03-29 18:49:31 [auto1.de] INFO: Saving data for KE07703: {'auction_closing_time': 1774882891.0, 'created_time': 1773427657.895962, 'last_price_update_time': 1774810171.381953}
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE07703') HTTP/1.1" 204 0
2026-03-29 18:49:31 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT07537%27 HTTP/1.1" 200 None
2026-03-29 18:49:31 [auto1.de] INFO: Scrape type for RT07537: 2
2026-03-29 18:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537
2026-03-29 18:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with scrape type 2
2026-03-29 18:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with scrape type 2
2026-03-29 18:49:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c33fb704-1fc2-55a4-9533-ce027dc4c6c8, identifier: RT07537
2026-03-29 18:49:31 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-29 18:49:31 [auto1.de] INFO: Scrape type for EW87662: 2
2026-03-29 18:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662
2026-03-29 18:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79540c1c-0156-5b32-b7cd-436a8d03764c with scrape type 2
2026-03-29 18:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79540c1c-0156-5b32-b7cd-436a8d03764c with scrape type 2
2026-03-29 18:49:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79540c1c-0156-5b32-b7cd-436a8d03764c, identifier: EW87662
2026-03-29 18:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537
2026-03-29 18:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537
2026-03-29 18:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c33fb704-1fc2-55a4-9533-ce027dc4c6c8 with identifier: RT07537 to the API
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:24:00Z',
'fuel_type': 'petrol',
'id': 'c33fb704-1fc2-55a4-9533-ce027dc4c6c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT07537',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 18429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-15',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2022}
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT07537%27 HTTP/1.1" 200 None
2026-03-29 18:49:31 [auto1.de] INFO: Saving data for RT07537: {'auction_closing_time': 1774884240.0, 'created_time': 1774723530.132577, 'last_price_update_time': 1774810171.9308}
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT07537') HTTP/1.1" 204 0
2026-03-29 18:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662
2026-03-29 18:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662
2026-03-29 18:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79540c1c-0156-5b32-b7cd-436a8d03764c with identifier: EW87662 to the API
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:08:12Z',
'fuel_type': 'petrol',
'id': '79540c1c-0156-5b32-b7cd-436a8d03764c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW87662',
'listing': 'auction',
'make': 'Audi',
'model': 'TT',
'odometer': 58912,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-10',
'seller_name': None,
'title': 'Audi TT 2.0 TFSI quattro Coupe',
'transmission': 'automatic',
'trim': 'quattro Coupe',
'year': 2017}
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-29 18:49:32 [auto1.de] INFO: Saving data for EW87662: {'auction_closing_time': 1774883292.0, 'created_time': 1774118742.161504, 'last_price_update_time': 1774810172.240644}
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW87662') HTTP/1.1" 204 0
2026-03-29 18:49:32 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-29 18:49:32 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-29 18:49:32 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-29 18:49:32 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-29 18:49:32 [auto1.de] INFO: Scrape type for FJ20192: 2
2026-03-29 18:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192
2026-03-29 18:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0a2038-466e-5898-8c5e-1c50a9fd499f with scrape type 2
2026-03-29 18:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0a2038-466e-5898-8c5e-1c50a9fd499f with scrape type 2
2026-03-29 18:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0a2038-466e-5898-8c5e-1c50a9fd499f, identifier: FJ20192
2026-03-29 18:49:32 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-29 18:49:32 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-29 18:49:32 [auto1.de] INFO: Scrape type for WS06165: 2
2026-03-29 18:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165
2026-03-29 18:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7d53189-39df-54df-96a7-7ff859397120 with scrape type 2
2026-03-29 18:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7d53189-39df-54df-96a7-7ff859397120 with scrape type 2
2026-03-29 18:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7d53189-39df-54df-96a7-7ff859397120, identifier: WS06165
2026-03-29 18:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192
2026-03-29 18:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192
2026-03-29 18:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0a2038-466e-5898-8c5e-1c50a9fd499f with identifier: FJ20192 to the API
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:29:54Z',
'fuel_type': 'petrol',
'id': '6b0a2038-466e-5898-8c5e-1c50a9fd499f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ20192',
'listing': 'auction',
'make': 'Ford',
'model': 'C-Max',
'odometer': 103731,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-10',
'seller_name': None,
'title': 'Ford C-Max 1.0 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-29 18:49:32 [auto1.de] INFO: Saving data for FJ20192: {'auction_closing_time': 1774884594.0, 'created_time': 1774464391.444324, 'last_price_update_time': 1774810172.767639}
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ20192') HTTP/1.1" 204 0
2026-03-29 18:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165
2026-03-29 18:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165
2026-03-29 18:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7d53189-39df-54df-96a7-7ff859397120 with identifier: WS06165 to the API
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:32:34Z',
'fuel_type': 'diesel',
'id': 'd7d53189-39df-54df-96a7-7ff859397120',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS06165',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 96287,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-18',
'seller_name': None,
'title': 'Renault Master 2.3 dCi Energy L2H2 HKa 3,5 Komfort',
'transmission': 'manual',
'trim': 'L2H2 HKa 3,5 Komfort',
'year': 2023}
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-29 18:49:33 [auto1.de] INFO: Saving data for WS06165: {'auction_closing_time': 1774884754.0, 'created_time': 1773429217.864546, 'last_price_update_time': 1774810173.148437}
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS06165') HTTP/1.1" 204 0
2026-03-29 18:49:33 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV42561%27 HTTP/1.1" 200 None
2026-03-29 18:49:33 [auto1.de] INFO: Scrape type for ZV42561: 2
2026-03-29 18:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561
2026-03-29 18:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f with scrape type 2
2026-03-29 18:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cf7cd61-6e60-586e-a88d-5f0d3707707f with scrape type 2
2026-03-29 18:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cf7cd61-6e60-586e-a88d-5f0d3707707f, identifier: ZV42561
2026-03-29 18:49:33 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-29 18:49:33 [auto1.de] INFO: Scrape type for XE70546: 2
2026-03-29 18:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546
2026-03-29 18:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with scrape type 2
2026-03-29 18:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with scrape type 2
2026-03-29 18:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf, identifier: XE70546
2026-03-29 18:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561
2026-03-29 18:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561
2026-03-29 18:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cf7cd61-6e60-586e-a88d-5f0d3707707f with identifier: ZV42561 to the API
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:20:28Z',
'fuel_type': 'petrol',
'id': '9cf7cd61-6e60-586e-a88d-5f0d3707707f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV42561',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 147751,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-12-07',
'seller_name': None,
'title': 'Opel Astra 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2007}
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV42561%27 HTTP/1.1" 200 None
2026-03-29 18:49:33 [auto1.de] INFO: Saving data for ZV42561: {'auction_closing_time': 1774884028.0, 'created_time': 1774723530.501443, 'last_price_update_time': 1774810173.655523}
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV42561') HTTP/1.1" 204 0
2026-03-29 18:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546
2026-03-29 18:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546
2026-03-29 18:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94e47550-1cba-5ee2-9b57-c588d8fcc0cf with identifier: XE70546 to the API
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:28Z',
'fuel_type': 'diesel',
'id': '94e47550-1cba-5ee2-9b57-c588d8fcc0cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE70546',
'listing': 'auction',
'make': 'Seat',
'model': 'Alhambra',
'odometer': 143112,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-28',
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI FR-Line',
'transmission': 'automatic',
'trim': 'FR-Line',
'year': 2018}
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-29 18:49:33 [auto1.de] INFO: Saving data for XE70546: {'auction_closing_time': 1774885828.0, 'created_time': 1774034279.192256, 'last_price_update_time': 1774810173.939692}
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE70546') HTTP/1.1" 204 0
2026-03-29 18:49:33 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-29 18:49:33 [auto1.de] INFO: Scrape type for YZ24956: 2
2026-03-29 18:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956
2026-03-29 18:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95e2ab5-d8b9-5f01-b74f-434272ed5510 with scrape type 2
2026-03-29 18:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95e2ab5-d8b9-5f01-b74f-434272ed5510 with scrape type 2
2026-03-29 18:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a95e2ab5-d8b9-5f01-b74f-434272ed5510, identifier: YZ24956
2026-03-29 18:49:34 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-29 18:49:34 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-29 18:49:34 [auto1.de] INFO: Scrape type for FK29510: 2
2026-03-29 18:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510
2026-03-29 18:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c241f8d4-8b37-535c-9843-0f0efeb9d986 with scrape type 2
2026-03-29 18:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c241f8d4-8b37-535c-9843-0f0efeb9d986 with scrape type 2
2026-03-29 18:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c241f8d4-8b37-535c-9843-0f0efeb9d986, identifier: FK29510
2026-03-29 18:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956
2026-03-29 18:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956
2026-03-29 18:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a95e2ab5-d8b9-5f01-b74f-434272ed5510 with identifier: YZ24956 to the API
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:30:47Z',
'fuel_type': 'gas',
'id': 'a95e2ab5-d8b9-5f01-b74f-434272ed5510',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ24956',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 26584,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-22',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
'transmission': 'manual',
'trim': 'Stepway Comfort',
'year': 2022}
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-29 18:49:34 [auto1.de] INFO: Saving data for YZ24956: {'auction_closing_time': 1774884647.0, 'created_time': 1774034528.901724, 'last_price_update_time': 1774810174.480539}
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ24956') HTTP/1.1" 204 0
2026-03-29 18:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510
2026-03-29 18:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510
2026-03-29 18:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c241f8d4-8b37-535c-9843-0f0efeb9d986 with identifier: FK29510 to the API
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:58:08Z',
'fuel_type': 'petrol',
'id': 'c241f8d4-8b37-535c-9843-0f0efeb9d986',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK29510',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 81180,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-22',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 150 Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2009}
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-29 18:49:34 [auto1.de] INFO: Saving data for FK29510: {'auction_closing_time': 1774886288.0, 'created_time': 1774723526.69701, 'last_price_update_time': 1774810174.895245}
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK29510') HTTP/1.1" 204 0
2026-03-29 18:49:34 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-29 18:49:34 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-29 18:49:34 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-29 18:49:34 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-29 18:49:34 [auto1.de] INFO: Scrape type for DG65550: 2
2026-03-29 18:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550
2026-03-29 18:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b1917fc-3c0f-58ff-be9e-ce284444534c with scrape type 2
2026-03-29 18:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b1917fc-3c0f-58ff-be9e-ce284444534c with scrape type 2
2026-03-29 18:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b1917fc-3c0f-58ff-be9e-ce284444534c, identifier: DG65550
2026-03-29 18:49:35 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-29 18:49:35 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27322%27 HTTP/1.1" 200 None
2026-03-29 18:49:35 [auto1.de] INFO: Scrape type for AP27322: 2
2026-03-29 18:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322
2026-03-29 18:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with scrape type 2
2026-03-29 18:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with scrape type 2
2026-03-29 18:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1b7d8c3-b009-5f71-a5b8-85f007982ed5, identifier: AP27322
2026-03-29 18:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550
2026-03-29 18:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550
2026-03-29 18:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b1917fc-3c0f-58ff-be9e-ce284444534c with identifier: DG65550 to the API
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:24:23Z',
'fuel_type': 'petrol',
'id': '5b1917fc-3c0f-58ff-be9e-ce284444534c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG65550',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 63779,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-25',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2014}
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-29 18:49:35 [auto1.de] INFO: Saving data for DG65550: {'auction_closing_time': 1774884263.0, 'created_time': 1774035523.480816, 'last_price_update_time': 1774810175.390914}
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG65550') HTTP/1.1" 204 0
2026-03-29 18:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322
2026-03-29 18:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322
2026-03-29 18:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1b7d8c3-b009-5f71-a5b8-85f007982ed5 with identifier: AP27322 to the API
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:45:34Z',
'fuel_type': 'petrol',
'id': 'f1b7d8c3-b009-5f71-a5b8-85f007982ed5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP27322',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 63546,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-09',
'seller_name': None,
'title': 'Peugeot 208 1.2 VTi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2017}
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27322%27 HTTP/1.1" 200 None
2026-03-29 18:49:35 [auto1.de] INFO: Saving data for AP27322: {'auction_closing_time': 1774885534.0, 'created_time': 1774031765.300595, 'last_price_update_time': 1774810175.683375}
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP27322') HTTP/1.1" 204 0
2026-03-29 18:49:35 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-29 18:49:35 [auto1.de] INFO: Scrape type for SW06849: 2
2026-03-29 18:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849
2026-03-29 18:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315139cd-e1eb-531c-81f3-4945d09fa18f with scrape type 2
2026-03-29 18:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 315139cd-e1eb-531c-81f3-4945d09fa18f with scrape type 2
2026-03-29 18:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 315139cd-e1eb-531c-81f3-4945d09fa18f, identifier: SW06849
2026-03-29 18:49:35 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW52708%27 HTTP/1.1" 200 None
2026-03-29 18:49:35 [auto1.de] INFO: Scrape type for NW52708: 2
2026-03-29 18:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708
2026-03-29 18:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with scrape type 2
2026-03-29 18:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with scrape type 2
2026-03-29 18:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d, identifier: NW52708
2026-03-29 18:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849
2026-03-29 18:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849
2026-03-29 18:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 315139cd-e1eb-531c-81f3-4945d09fa18f with identifier: SW06849 to the API
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:05:55Z',
'fuel_type': 'petrol',
'id': '315139cd-e1eb-531c-81f3-4945d09fa18f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW06849',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 1297,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-11-16',
'seller_name': None,
'title': 'Renault Kangoo 1.3 TCe Techno',
'transmission': 'automatic',
'trim': 'Techno',
'year': 2025}
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-29 18:49:36 [auto1.de] INFO: Saving data for SW06849: {'auction_closing_time': 1774883155.0, 'created_time': 1774723538.913981, 'last_price_update_time': 1774810176.193264}
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW06849') HTTP/1.1" 204 0
2026-03-29 18:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708
2026-03-29 18:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708
2026-03-29 18:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdc5cc5d-f336-5200-b9c3-3919d5c08c8d with identifier: NW52708 to the API
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:54:48Z',
'fuel_type': 'petrol',
'id': 'cdc5cc5d-f336-5200-b9c3-3919d5c08c8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW52708',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 157956,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-03-28',
'seller_name': None,
'title': 'Hyundai Tucson 2.0 Team 06',
'transmission': 'manual',
'trim': 'Team 06',
'year': 2007}
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW52708%27 HTTP/1.1" 200 None
2026-03-29 18:49:36 [auto1.de] INFO: Saving data for NW52708: {'auction_closing_time': 1774886088.0, 'created_time': 1774723513.456677, 'last_price_update_time': 1774810176.524431}
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW52708') HTTP/1.1" 204 0
2026-03-29 18:49:36 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-29 18:49:36 [auto1.de] INFO: Scrape type for GZ70356: 2
2026-03-29 18:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356
2026-03-29 18:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48827fb7-37ff-5368-b412-b99f8a5b3774 with scrape type 2
2026-03-29 18:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48827fb7-37ff-5368-b412-b99f8a5b3774 with scrape type 2
2026-03-29 18:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48827fb7-37ff-5368-b412-b99f8a5b3774, identifier: GZ70356
2026-03-29 18:49:36 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH18171%27 HTTP/1.1" 200 None
2026-03-29 18:49:36 [auto1.de] INFO: Scrape type for NH18171: 2
2026-03-29 18:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171
2026-03-29 18:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6434537c-c830-551c-819b-37c664f296fe with scrape type 2
2026-03-29 18:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6434537c-c830-551c-819b-37c664f296fe with scrape type 2
2026-03-29 18:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6434537c-c830-551c-819b-37c664f296fe, identifier: NH18171
2026-03-29 18:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356
2026-03-29 18:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356
2026-03-29 18:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48827fb7-37ff-5368-b412-b99f8a5b3774 with identifier: GZ70356 to the API
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 128,
'expiration_date': '2026-03-30T15:08:48Z',
'fuel_type': 'diesel',
'id': '48827fb7-37ff-5368-b412-b99f8a5b3774',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ70356',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 225154,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-30',
'seller_name': None,
'title': "Kia cee'd 1.6 CRDi Spirit",
'transmission': 'manual',
'trim': 'Spirit',
'year': 2013}
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-29 18:49:37 [auto1.de] INFO: Saving data for GZ70356: {'auction_closing_time': 1774883328.0, 'created_time': 1774723610.695857, 'last_price_update_time': 1774810177.032695}
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ70356') HTTP/1.1" 204 0
2026-03-29 18:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171
2026-03-29 18:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171
2026-03-29 18:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6434537c-c830-551c-819b-37c664f296fe with identifier: NH18171 to the API
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:09:58Z',
'fuel_type': 'petrol',
'id': '6434537c-c830-551c-819b-37c664f296fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH18171',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 33330,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-22',
'seller_name': None,
'title': 'Renault Captur 0.9 TCe Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2019}
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH18171%27 HTTP/1.1" 200 None
2026-03-29 18:49:37 [auto1.de] INFO: Saving data for NH18171: {'auction_closing_time': 1774883398.0, 'created_time': 1774118372.477069, 'last_price_update_time': 1774810177.354295}
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH18171') HTTP/1.1" 204 0
2026-03-29 18:49:37 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-29 18:49:37 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-29 18:49:37 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-29 18:49:37 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-29 18:49:37 [auto1.de] INFO: Scrape type for XM98153: 2
2026-03-29 18:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153
2026-03-29 18:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc3e0f0-76bf-5377-a863-0095d26634d1 with scrape type 2
2026-03-29 18:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc3e0f0-76bf-5377-a863-0095d26634d1 with scrape type 2
2026-03-29 18:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dc3e0f0-76bf-5377-a863-0095d26634d1, identifier: XM98153
2026-03-29 18:49:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:37 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-29 18:49:37 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN22818%27 HTTP/1.1" 200 None
2026-03-29 18:49:37 [auto1.de] INFO: Scrape type for JN22818: 2
2026-03-29 18:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818
2026-03-29 18:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with scrape type 2
2026-03-29 18:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with scrape type 2
2026-03-29 18:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48, identifier: JN22818
2026-03-29 18:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153
2026-03-29 18:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153
2026-03-29 18:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dc3e0f0-76bf-5377-a863-0095d26634d1 with identifier: XM98153 to the API
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:33Z',
'fuel_type': 'diesel',
'id': '4dc3e0f0-76bf-5377-a863-0095d26634d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM98153',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 109660,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-04',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Business M',
'transmission': 'manual',
'trim': 'Business M',
'year': 2017}
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-29 18:49:37 [auto1.de] INFO: Saving data for XM98153: {'auction_closing_time': 1774886073.0, 'created_time': 1773429542.875939, 'last_price_update_time': 1774810177.873117}
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM98153') HTTP/1.1" 204 0
2026-03-29 18:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818
2026-03-29 18:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818
2026-03-29 18:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b94ab2-dad9-5ba9-9afc-b98728cb8c48 with identifier: JN22818 to the API
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:12:47Z',
'fuel_type': 'diesel',
'id': '08b94ab2-dad9-5ba9-9afc-b98728cb8c48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN22818',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 67859,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-04',
'seller_name': None,
'title': 'Audi Q5 40 TDI Mild-Hybrid quattro advanced',
'transmission': 'automatic',
'trim': 'quattro advanced',
'year': 2021}
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN22818%27 HTTP/1.1" 200 None
2026-03-29 18:49:38 [auto1.de] INFO: Saving data for JN22818: {'auction_closing_time': 1774883567.0, 'created_time': 1774723512.190869, 'last_price_update_time': 1774810178.259656}
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN22818') HTTP/1.1" 204 0
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM97127%27 HTTP/1.1" 200 None
2026-03-29 18:49:38 [auto1.de] INFO: Scrape type for TM97127: 2
2026-03-29 18:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127
2026-03-29 18:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f0cf49-8191-50e2-baae-e8bb3be7b93e with scrape type 2
2026-03-29 18:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f0cf49-8191-50e2-baae-e8bb3be7b93e with scrape type 2
2026-03-29 18:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4f0cf49-8191-50e2-baae-e8bb3be7b93e, identifier: TM97127
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-29 18:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127
2026-03-29 18:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127
2026-03-29 18:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4f0cf49-8191-50e2-baae-e8bb3be7b93e with identifier: TM97127 to the API
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:47:52Z',
'fuel_type': 'petrol',
'id': 'a4f0cf49-8191-50e2-baae-e8bb3be7b93e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM97127',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 160326,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-11-08',
'seller_name': None,
'title': 'Toyota Yaris 1.3 VVT-i Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2006}
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM97127%27 HTTP/1.1" 200 None
2026-03-29 18:49:38 [auto1.de] INFO: Saving data for TM97127: {'auction_closing_time': 1774885672.0, 'created_time': 1773400892.474072, 'last_price_update_time': 1774810178.659345}
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM97127') HTTP/1.1" 204 0
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-29 18:49:38 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB09378%27 HTTP/1.1" 200 None
2026-03-29 18:49:38 [auto1.de] INFO: Scrape type for ZB09378: 2
2026-03-29 18:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378
2026-03-29 18:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with scrape type 2
2026-03-29 18:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with scrape type 2
2026-03-29 18:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72, identifier: ZB09378
2026-03-29 18:49:38 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6740 | hits on page: 40
2026-03-29 18:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378
2026-03-29 18:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378
2026-03-29 18:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99765fec-567f-56f4-8f1d-a2ea5e2c6c72 with identifier: ZB09378 to the API
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:17:27Z',
'fuel_type': 'petrol',
'id': '99765fec-567f-56f4-8f1d-a2ea5e2c6c72',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB09378',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 115383,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-07',
'seller_name': None,
'title': 'MINI Countryman One',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB09378%27 HTTP/1.1" 200 None
2026-03-29 18:49:39 [auto1.de] INFO: Saving data for ZB09378: {'auction_closing_time': 1774883847.0, 'created_time': 1774723552.017932, 'last_price_update_time': 1774810179.04184}
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB09378') HTTP/1.1" 204 0
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97586%27 HTTP/1.1" 200 None
2026-03-29 18:49:39 [auto1.de] INFO: Scrape type for ES97586: 2
2026-03-29 18:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586
2026-03-29 18:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 112ccead-de1c-5e88-88a5-1016072e3bab with scrape type 2
2026-03-29 18:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 112ccead-de1c-5e88-88a5-1016072e3bab with scrape type 2
2026-03-29 18:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 112ccead-de1c-5e88-88a5-1016072e3bab, identifier: ES97586
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-29 18:49:39 [auto1.de] INFO: Scrape type for VG60095: 2
2026-03-29 18:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095
2026-03-29 18:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with scrape type 2
2026-03-29 18:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with scrape type 2
2026-03-29 18:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4, identifier: VG60095
2026-03-29 18:49:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586
2026-03-29 18:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586
2026-03-29 18:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 112ccead-de1c-5e88-88a5-1016072e3bab with identifier: ES97586 to the API
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 325,
'expiration_date': '2026-03-30T15:04:58Z',
'fuel_type': 'diesel',
'id': '112ccead-de1c-5e88-88a5-1016072e3bab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES97586',
'listing': 'auction',
'make': 'Audi',
'model': 'SQ5',
'odometer': 135943,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-16',
'seller_name': None,
'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
'transmission': 'automatic',
'trim': 'quattro Competition',
'year': 2015}
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97586%27 HTTP/1.1" 200 None
2026-03-29 18:49:39 [auto1.de] INFO: Saving data for ES97586: {'auction_closing_time': 1774883098.0, 'created_time': 1774349950.111334, 'last_price_update_time': 1774810179.665422}
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES97586') HTTP/1.1" 204 0
2026-03-29 18:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095
2026-03-29 18:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095
2026-03-29 18:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fad2625-0521-53bd-bd3e-9dc3b5acfef4 with identifier: VG60095 to the API
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 295,
'expiration_date': '2026-03-30T15:31:37Z',
'fuel_type': 'petrol',
'id': '3fad2625-0521-53bd-bd3e-9dc3b5acfef4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG60095',
'listing': 'auction',
'make': 'Porsche',
'model': 'Boxster',
'odometer': 137804,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-14',
'seller_name': None,
'title': 'Porsche Boxster S',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-29 18:49:39 [auto1.de] INFO: Saving data for VG60095: {'auction_closing_time': 1774884697.0, 'created_time': 1774552871.505448, 'last_price_update_time': 1774810179.972219}
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG60095') HTTP/1.1" 204 0
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-29 18:49:39 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW27042%27 HTTP/1.1" 200 None
2026-03-29 18:49:40 [auto1.de] INFO: Scrape type for MW27042: 2
2026-03-29 18:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042
2026-03-29 18:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf4fea5-e2d7-52bb-89fc-178af414a85f with scrape type 2
2026-03-29 18:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bf4fea5-e2d7-52bb-89fc-178af414a85f with scrape type 2
2026-03-29 18:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bf4fea5-e2d7-52bb-89fc-178af414a85f, identifier: MW27042
2026-03-29 18:49:40 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-29 18:49:40 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-29 18:49:40 [auto1.de] INFO: Scrape type for NW19977: 2
2026-03-29 18:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977
2026-03-29 18:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b63275-aa4b-5033-bf85-4b567902570c with scrape type 2
2026-03-29 18:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b63275-aa4b-5033-bf85-4b567902570c with scrape type 2
2026-03-29 18:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27b63275-aa4b-5033-bf85-4b567902570c, identifier: NW19977
2026-03-29 18:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042
2026-03-29 18:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042
2026-03-29 18:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bf4fea5-e2d7-52bb-89fc-178af414a85f with identifier: MW27042 to the API
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:13:13Z',
'fuel_type': 'petrol',
'id': '6bf4fea5-e2d7-52bb-89fc-178af414a85f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW27042',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 117185,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-10',
'seller_name': None,
'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2011}
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW27042%27 HTTP/1.1" 200 None
2026-03-29 18:49:40 [auto1.de] INFO: Saving data for MW27042: {'auction_closing_time': 1774883593.0, 'created_time': 1774723540.774214, 'last_price_update_time': 1774810180.488891}
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW27042') HTTP/1.1" 204 0
2026-03-29 18:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977
2026-03-29 18:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977
2026-03-29 18:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27b63275-aa4b-5033-bf85-4b567902570c with identifier: NW19977 to the API
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 158,
'expiration_date': '2026-03-30T15:00:15Z',
'fuel_type': 'petrol',
'id': '27b63275-aa4b-5033-bf85-4b567902570c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW19977',
'listing': 'auction',
'make': 'Renault',
'model': 'Koleos',
'odometer': 59663,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-09-26',
'seller_name': None,
'title': 'Renault Koleos 1.3 TCe Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2022}
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-29 18:49:40 [auto1.de] INFO: Saving data for NW19977: {'auction_closing_time': 1774882815.0, 'created_time': 1774552879.78697, 'last_price_update_time': 1774810180.876552}
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW19977') HTTP/1.1" 204 0
2026-03-29 18:49:40 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-29 18:49:40 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF79484%27 HTTP/1.1" 200 None
2026-03-29 18:49:40 [auto1.de] INFO: Scrape type for VF79484: 2
2026-03-29 18:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484
2026-03-29 18:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56f04d6-ee26-5e85-9c86-d4f783338dc4 with scrape type 2
2026-03-29 18:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56f04d6-ee26-5e85-9c86-d4f783338dc4 with scrape type 2
2026-03-29 18:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f56f04d6-ee26-5e85-9c86-d4f783338dc4, identifier: VF79484
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-29 18:49:41 [auto1.de] INFO: Scrape type for ND45572: 2
2026-03-29 18:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572
2026-03-29 18:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 553db04f-1f1d-54ba-9a79-789c3febf6e2 with scrape type 2
2026-03-29 18:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 553db04f-1f1d-54ba-9a79-789c3febf6e2 with scrape type 2
2026-03-29 18:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 553db04f-1f1d-54ba-9a79-789c3febf6e2, identifier: ND45572
2026-03-29 18:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484
2026-03-29 18:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484
2026-03-29 18:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f56f04d6-ee26-5e85-9c86-d4f783338dc4 with identifier: VF79484 to the API
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:05:46Z',
'fuel_type': 'petrol',
'id': 'f56f04d6-ee26-5e85-9c86-d4f783338dc4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF79484',
'listing': 'auction',
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 117114,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-09-11',
'seller_name': None,
'title': 'Suzuki Jimny 1.3 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2002}
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF79484%27 HTTP/1.1" 200 None
2026-03-29 18:49:41 [auto1.de] INFO: Saving data for VF79484: {'auction_closing_time': 1774883146.0, 'created_time': 1774350051.613492, 'last_price_update_time': 1774810181.407532}
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF79484') HTTP/1.1" 204 0
2026-03-29 18:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572
2026-03-29 18:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572
2026-03-29 18:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 553db04f-1f1d-54ba-9a79-789c3febf6e2 with identifier: ND45572 to the API
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:42:40Z',
'fuel_type': 'diesel',
'id': '553db04f-1f1d-54ba-9a79-789c3febf6e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND45572',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Citan',
'odometer': 56598,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-03',
'seller_name': None,
'title': 'Mercedes-Benz Citan 112 CDI PRO',
'transmission': 'manual',
'trim': 'PRO',
'year': 2022}
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-29 18:49:41 [auto1.de] INFO: Saving data for ND45572: {'auction_closing_time': 1774885360.0, 'created_time': 1774350532.43982, 'last_price_update_time': 1774810181.691174}
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND45572') HTTP/1.1" 204 0
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS53721%27 HTTP/1.1" 200 None
2026-03-29 18:49:41 [auto1.de] INFO: Scrape type for YS53721: 2
2026-03-29 18:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721
2026-03-29 18:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb48922-a012-5054-a92f-b848665cc20a with scrape type 2
2026-03-29 18:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecb48922-a012-5054-a92f-b848665cc20a with scrape type 2
2026-03-29 18:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecb48922-a012-5054-a92f-b848665cc20a, identifier: YS53721
2026-03-29 18:49:41 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-29 18:49:41 [auto1.de] INFO: Scrape type for XK76650: 2
2026-03-29 18:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650
2026-03-29 18:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with scrape type 2
2026-03-29 18:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with scrape type 2
2026-03-29 18:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432, identifier: XK76650
2026-03-29 18:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721
2026-03-29 18:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721
2026-03-29 18:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecb48922-a012-5054-a92f-b848665cc20a with identifier: YS53721 to the API
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:18:23Z',
'fuel_type': 'diesel',
'id': 'ecb48922-a012-5054-a92f-b848665cc20a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS53721',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 256757,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-30',
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2015}
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS53721%27 HTTP/1.1" 200 None
2026-03-29 18:49:42 [auto1.de] INFO: Saving data for YS53721: {'auction_closing_time': 1774883903.0, 'created_time': 1774033778.500654, 'last_price_update_time': 1774810182.202596}
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS53721') HTTP/1.1" 204 0
2026-03-29 18:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650
2026-03-29 18:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650
2026-03-29 18:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 819f4262-d4d9-5cd8-ba6c-dbc7abc4a432 with identifier: XK76650 to the API
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:02:53Z',
'fuel_type': 'petrol',
'id': '819f4262-d4d9-5cd8-ba6c-dbc7abc4a432',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK76650',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 116899,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-31',
'seller_name': None,
'title': 'Honda Jazz 1.2 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-29 18:49:42 [auto1.de] INFO: Saving data for XK76650: {'auction_closing_time': 1774882973.0, 'created_time': 1773399135.452384, 'last_price_update_time': 1774810182.580208}
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK76650') HTTP/1.1" 204 0
2026-03-29 18:49:42 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX07210%27 HTTP/1.1" 200 None
2026-03-29 18:49:42 [auto1.de] INFO: Scrape type for NX07210: 2
2026-03-29 18:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210
2026-03-29 18:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126893cc-3fd9-55fd-83b5-98d7375075ed with scrape type 2
2026-03-29 18:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 126893cc-3fd9-55fd-83b5-98d7375075ed with scrape type 2
2026-03-29 18:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 126893cc-3fd9-55fd-83b5-98d7375075ed, identifier: NX07210
2026-03-29 18:49:42 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-29 18:49:42 [auto1.de] INFO: Scrape type for CL01053: 2
2026-03-29 18:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053
2026-03-29 18:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e6b87ac-7b0d-549f-9093-c347185962f5 with scrape type 2
2026-03-29 18:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e6b87ac-7b0d-549f-9093-c347185962f5 with scrape type 2
2026-03-29 18:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e6b87ac-7b0d-549f-9093-c347185962f5, identifier: CL01053
2026-03-29 18:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210
2026-03-29 18:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210
2026-03-29 18:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 126893cc-3fd9-55fd-83b5-98d7375075ed with identifier: NX07210 to the API
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:28:07Z',
'fuel_type': 'petrol',
'id': '126893cc-3fd9-55fd-83b5-98d7375075ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX07210',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira',
'odometer': 83791,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-22',
'seller_name': None,
'title': 'Opel Zafira 1.8 Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2014}
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX07210%27 HTTP/1.1" 200 None
2026-03-29 18:49:43 [auto1.de] INFO: Saving data for NX07210: {'auction_closing_time': 1774884487.0, 'created_time': 1774723533.456502, 'last_price_update_time': 1774810183.094365}
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX07210') HTTP/1.1" 204 0
2026-03-29 18:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053
2026-03-29 18:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053
2026-03-29 18:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e6b87ac-7b0d-549f-9093-c347185962f5 with identifier: CL01053 to the API
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:47:33Z',
'fuel_type': 'diesel',
'id': '3e6b87ac-7b0d-549f-9093-c347185962f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL01053',
'listing': 'auction',
'make': 'Dacia',
'model': 'Logan',
'odometer': 149937,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-01',
'seller_name': None,
'title': 'Dacia Logan 1.5 dCi Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2006}
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-29 18:49:43 [auto1.de] INFO: Saving data for CL01053: {'auction_closing_time': 1774885653.0, 'created_time': 1774723699.651373, 'last_price_update_time': 1774810183.385263}
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL01053') HTTP/1.1" 204 0
2026-03-29 18:49:43 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-29 18:49:43 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR70378%27 HTTP/1.1" 200 None
2026-03-29 18:49:43 [auto1.de] INFO: Scrape type for LR70378: 2
2026-03-29 18:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378
2026-03-29 18:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e09ba225-9cf8-5545-a095-84e7df17ffc9 with scrape type 2
2026-03-29 18:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e09ba225-9cf8-5545-a095-84e7df17ffc9 with scrape type 2
2026-03-29 18:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e09ba225-9cf8-5545-a095-84e7df17ffc9, identifier: LR70378
2026-03-29 18:49:43 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-29 18:49:43 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-29 18:49:43 [auto1.de] INFO: Scrape type for TD36353: 2
2026-03-29 18:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353
2026-03-29 18:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with scrape type 2
2026-03-29 18:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with scrape type 2
2026-03-29 18:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86, identifier: TD36353
2026-03-29 18:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378
2026-03-29 18:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378
2026-03-29 18:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e09ba225-9cf8-5545-a095-84e7df17ffc9 with identifier: LR70378 to the API
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:51:03Z',
'fuel_type': 'diesel',
'id': 'e09ba225-9cf8-5545-a095-84e7df17ffc9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR70378',
'listing': 'auction',
'make': 'Nissan',
'model': 'NP300 Pick-up',
'odometer': 25301,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-23',
'seller_name': None,
'title': 'Nissan NP300 Pick-up 2.3 dCi Acenta King Cab 4x4',
'transmission': 'manual',
'trim': 'Acenta King Cab 4x4',
'year': 2019}
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR70378%27 HTTP/1.1" 200 None
2026-03-29 18:49:43 [auto1.de] INFO: Saving data for LR70378: {'auction_closing_time': 1774885863.0, 'created_time': 1774723531.863706, 'last_price_update_time': 1774810183.88567}
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR70378') HTTP/1.1" 204 0
2026-03-29 18:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353
2026-03-29 18:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353
2026-03-29 18:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21f4d8c2-5f55-5e8b-adfe-21a0860bfc86 with identifier: TD36353 to the API
2026-03-29 18:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:38:02Z',
'fuel_type': 'petrol',
'id': '21f4d8c2-5f55-5e8b-adfe-21a0860bfc86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD36353',
'listing': 'auction',
'make': 'Nissan',
'model': 'Micra',
'odometer': 130920,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-27',
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2011}
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-29 18:49:44 [auto1.de] INFO: Saving data for TD36353: {'auction_closing_time': 1774885082.0, 'created_time': 1774002212.216731, 'last_price_update_time': 1774810184.169406}
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD36353') HTTP/1.1" 204 0
2026-03-29 18:49:44 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-29 18:49:44 [auto1.de] INFO: Scrape type for UX88157: 2
2026-03-29 18:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157
2026-03-29 18:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a with scrape type 2
2026-03-29 18:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88930ba8-f3d1-5c62-81dc-0c30afb5557a with scrape type 2
2026-03-29 18:49:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88930ba8-f3d1-5c62-81dc-0c30afb5557a, identifier: UX88157
2026-03-29 18:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157
2026-03-29 18:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157
2026-03-29 18:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88930ba8-f3d1-5c62-81dc-0c30afb5557a with identifier: UX88157 to the API
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:55:47Z',
'fuel_type': 'petrol',
'id': '88930ba8-f3d1-5c62-81dc-0c30afb5557a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX88157',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLC-Klasse',
'odometer': 155112,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-12-16',
'seller_name': None,
'title': 'Mercedes-Benz CLC-Klasse CLC 200 Kompressor',
'transmission': 'automatic',
'trim': '',
'year': 2008}
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-29 18:49:44 [auto1.de] INFO: Saving data for UX88157: {'auction_closing_time': 1774886147.0, 'created_time': 1774723592.772926, 'last_price_update_time': 1774810184.55648}
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX88157') HTTP/1.1" 204 0
2026-03-29 18:49:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:44 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-29 18:49:44 [auto1.de] INFO: Scrape type for PS96436: 2
2026-03-29 18:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436
2026-03-29 18:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4b61e75-3e7f-5f29-8231-9b5e24136a77 with scrape type 2
2026-03-29 18:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4b61e75-3e7f-5f29-8231-9b5e24136a77 with scrape type 2
2026-03-29 18:49:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4b61e75-3e7f-5f29-8231-9b5e24136a77, identifier: PS96436
2026-03-29 18:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436
2026-03-29 18:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436
2026-03-29 18:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4b61e75-3e7f-5f29-8231-9b5e24136a77 with identifier: PS96436 to the API
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:02:50Z',
'fuel_type': 'diesel',
'id': 'b4b61e75-3e7f-5f29-8231-9b5e24136a77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS96436',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 192550,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-16',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2018}
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-29 18:49:44 [auto1.de] INFO: Saving data for PS96436: {'auction_closing_time': 1774882970.0, 'created_time': 1774350731.327676, 'last_price_update_time': 1774810184.9479}
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS96436') HTTP/1.1" 204 0
2026-03-29 18:49:44 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-29 18:49:44 [auto1.de] INFO: Scrape type for CA26041: 2
2026-03-29 18:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041
2026-03-29 18:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ddb400-0a69-51a3-ace4-0de89fb10947 with scrape type 2
2026-03-29 18:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6ddb400-0a69-51a3-ace4-0de89fb10947 with scrape type 2
2026-03-29 18:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6ddb400-0a69-51a3-ace4-0de89fb10947, identifier: CA26041
2026-03-29 18:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041
2026-03-29 18:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041
2026-03-29 18:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6ddb400-0a69-51a3-ace4-0de89fb10947 with identifier: CA26041 to the API
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:59:28Z',
'fuel_type': 'diesel',
'id': 'e6ddb400-0a69-51a3-ace4-0de89fb10947',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA26041',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 221214,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-02',
'seller_name': None,
'title': 'Volvo XC40 2.0 D3 2WD',
'transmission': 'automatic',
'trim': '2WD',
'year': 2019}
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-29 18:49:45 [auto1.de] INFO: Saving data for CA26041: {'auction_closing_time': 1774886368.0, 'created_time': 1774002224.956563, 'last_price_update_time': 1774810185.338658}
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA26041') HTTP/1.1" 204 0
2026-03-29 18:49:45 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 6740 | hits on page: 40
2026-03-29 18:49:45 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-29 18:49:45 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-29 18:49:45 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-29 18:49:45 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-29 18:49:45 [auto1.de] INFO: Scrape type for HJ08295: 2
2026-03-29 18:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295
2026-03-29 18:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc64e49-56b2-53bd-88c6-a84311c425b1 with scrape type 2
2026-03-29 18:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc64e49-56b2-53bd-88c6-a84311c425b1 with scrape type 2
2026-03-29 18:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dc64e49-56b2-53bd-88c6-a84311c425b1, identifier: HJ08295
2026-03-29 18:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295
2026-03-29 18:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295
2026-03-29 18:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dc64e49-56b2-53bd-88c6-a84311c425b1 with identifier: HJ08295 to the API
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:50:10Z',
'fuel_type': 'diesel',
'id': '4dc64e49-56b2-53bd-88c6-a84311c425b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ08295',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 161039,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-12',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Edition',
'transmission': 'manual',
'trim': 'Business Edition',
'year': 2016}
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-29 18:49:45 [auto1.de] INFO: Saving data for HJ08295: {'auction_closing_time': 1774885810.0, 'created_time': 1774723596.003835, 'last_price_update_time': 1774810185.729878}
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ08295') HTTP/1.1" 204 0
2026-03-29 18:49:45 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-29 18:49:45 [auto1.de] INFO: Scrape type for TT73177: 2
2026-03-29 18:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177
2026-03-29 18:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91cd726-46a4-5c15-9a4b-eb452846b8e2 with scrape type 2
2026-03-29 18:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a91cd726-46a4-5c15-9a4b-eb452846b8e2 with scrape type 2
2026-03-29 18:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a91cd726-46a4-5c15-9a4b-eb452846b8e2, identifier: TT73177
2026-03-29 18:49:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:49:45 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-29 18:49:45 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-29 18:49:45 [auto1.de] INFO: Scrape type for AL40501: 2
2026-03-29 18:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501
2026-03-29 18:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e7b8cf-e483-5612-9da2-b577de5a4306 with scrape type 2
2026-03-29 18:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20e7b8cf-e483-5612-9da2-b577de5a4306 with scrape type 2
2026-03-29 18:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20e7b8cf-e483-5612-9da2-b577de5a4306, identifier: AL40501
2026-03-29 18:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177
2026-03-29 18:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177
2026-03-29 18:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a91cd726-46a4-5c15-9a4b-eb452846b8e2 with identifier: TT73177 to the API
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:29:51Z',
'fuel_type': 'petrol',
'id': 'a91cd726-46a4-5c15-9a4b-eb452846b8e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT73177',
'listing': 'auction',
'make': 'Mazda',
'model': '5',
'odometer': 181912,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-01',
'seller_name': None,
'title': 'Mazda 5 1.8 Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2009}
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-29 18:49:46 [auto1.de] INFO: Saving data for TT73177: {'auction_closing_time': 1774884591.0, 'created_time': 1773429008.956638, 'last_price_update_time': 1774810186.37913}
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT73177') HTTP/1.1" 204 0
2026-03-29 18:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501
2026-03-29 18:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501
2026-03-29 18:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20e7b8cf-e483-5612-9da2-b577de5a4306 with identifier: AL40501 to the API
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:58:03Z',
'fuel_type': 'petrol',
'id': '20e7b8cf-e483-5612-9da2-b577de5a4306',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL40501',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 100078,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-08',
'seller_name': None,
'title': 'Opel Corsa 1.4 Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2015}
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-29 18:49:46 [auto1.de] INFO: Saving data for AL40501: {'auction_closing_time': 1774886283.0, 'created_time': 1774723635.69187, 'last_price_update_time': 1774810186.658163}
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL40501') HTTP/1.1" 204 0
2026-03-29 18:49:46 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-29 18:49:46 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-29 18:49:46 [auto1.de] INFO: Scrape type for DZ73228: 2
2026-03-29 18:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228
2026-03-29 18:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with scrape type 2
2026-03-29 18:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with scrape type 2
2026-03-29 18:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4fa49ad-ac77-5bce-bb06-2aed10975fc1, identifier: DZ73228
2026-03-29 18:49:46 [auto1.de] INFO: Found listing with ID: US66744
2026-03-29 18:49:46 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-29 18:49:46 [auto1.de] INFO: Scrape type for WF58596: 2
2026-03-29 18:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596
2026-03-29 18:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38aaa83e-a550-5222-a43c-bf09055b54ec with scrape type 2
2026-03-29 18:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38aaa83e-a550-5222-a43c-bf09055b54ec with scrape type 2
2026-03-29 18:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38aaa83e-a550-5222-a43c-bf09055b54ec, identifier: WF58596
2026-03-29 18:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228
2026-03-29 18:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228
2026-03-29 18:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4fa49ad-ac77-5bce-bb06-2aed10975fc1 with identifier: DZ73228 to the API
2026-03-29 18:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:09:59Z',
'fuel_type': 'diesel',
'id': 'f4fa49ad-ac77-5bce-bb06-2aed10975fc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ73228',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 33556,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-09-16',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TDI Goal',
'transmission': 'automatic',
'trim': 'Goal',
'year': 2024}
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-29 18:49:47 [auto1.de] INFO: Saving data for DZ73228: {'auction_closing_time': 1774883399.0, 'created_time': 1774723572.680888, 'last_price_update_time': 1774810187.181304}
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ73228') HTTP/1.1" 204 0
2026-03-29 18:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596
2026-03-29 18:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596
2026-03-29 18:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38aaa83e-a550-5222-a43c-bf09055b54ec with identifier: WF58596 to the API
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:27:27Z',
'fuel_type': 'petrol',
'id': '38aaa83e-a550-5222-a43c-bf09055b54ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF58596',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 150802,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-11-04',
'seller_name': None,
'title': 'Volkswagen Touran 1.2 TSI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2010}
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-29 18:49:47 [auto1.de] INFO: Saving data for WF58596: {'auction_closing_time': 1774884447.0, 'created_time': 1774723626.412123, 'last_price_update_time': 1774810187.472636}
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF58596') HTTP/1.1" 204 0
2026-03-29 18:49:47 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-29 18:49:47 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-29 18:49:47 [auto1.de] INFO: Scrape type for BT55955: 2
2026-03-29 18:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955
2026-03-29 18:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b961ea-ec5b-556d-8337-e84209cb427a with scrape type 2
2026-03-29 18:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9b961ea-ec5b-556d-8337-e84209cb427a with scrape type 2
2026-03-29 18:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9b961ea-ec5b-556d-8337-e84209cb427a, identifier: BT55955
2026-03-29 18:49:47 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-29 18:49:47 [auto1.de] INFO: Scrape type for HP30052: 2
2026-03-29 18:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052
2026-03-29 18:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dacbc264-ffe0-58ec-b786-e41a842ba298 with scrape type 2
2026-03-29 18:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dacbc264-ffe0-58ec-b786-e41a842ba298 with scrape type 2
2026-03-29 18:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dacbc264-ffe0-58ec-b786-e41a842ba298, identifier: HP30052
2026-03-29 18:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955
2026-03-29 18:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955
2026-03-29 18:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9b961ea-ec5b-556d-8337-e84209cb427a with identifier: BT55955 to the API
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:20:42Z',
'fuel_type': 'petrol',
'id': 'd9b961ea-ec5b-556d-8337-e84209cb427a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT55955',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 127373,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-09',
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2017}
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-29 18:49:48 [auto1.de] INFO: Saving data for BT55955: {'auction_closing_time': 1774884042.0, 'created_time': 1774723640.229315, 'last_price_update_time': 1774810188.061279}
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT55955') HTTP/1.1" 204 0
2026-03-29 18:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052
2026-03-29 18:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052
2026-03-29 18:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dacbc264-ffe0-58ec-b786-e41a842ba298 with identifier: HP30052 to the API
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:22:49Z',
'fuel_type': 'petrol',
'id': 'dacbc264-ffe0-58ec-b786-e41a842ba298',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP30052',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 111011,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-11',
'seller_name': None,
'title': 'Opel Astra 1.4 Turbo Design Edition',
'transmission': 'manual',
'trim': 'Design Edition',
'year': 2011}
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-29 18:49:48 [auto1.de] INFO: Saving data for HP30052: {'auction_closing_time': 1774884169.0, 'created_time': 1774723629.071012, 'last_price_update_time': 1774810188.352578}
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP30052') HTTP/1.1" 204 0
2026-03-29 18:49:48 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-29 18:49:48 [auto1.de] INFO: Scrape type for XT21551: 2
2026-03-29 18:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551
2026-03-29 18:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with scrape type 2
2026-03-29 18:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with scrape type 2
2026-03-29 18:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd, identifier: XT21551
2026-03-29 18:49:48 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-29 18:49:48 [auto1.de] INFO: Scrape type for RT47702: 2
2026-03-29 18:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702
2026-03-29 18:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aee205-5c9c-5e64-b445-02144e19996f with scrape type 2
2026-03-29 18:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57aee205-5c9c-5e64-b445-02144e19996f with scrape type 2
2026-03-29 18:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57aee205-5c9c-5e64-b445-02144e19996f, identifier: RT47702
2026-03-29 18:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551
2026-03-29 18:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551
2026-03-29 18:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd with identifier: XT21551 to the API
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:54:23Z',
'fuel_type': 'diesel',
'id': '7c2b17c5-8bdb-5b50-a22a-03f16a03d9cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT21551',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 198712,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-03-19',
'seller_name': None,
'title': 'Renault Master 2.2 Diesel L1H1 Basis Kasten RS 3078',
'transmission': 'manual',
'trim': 'L1H1 Basis Kasten RS 3078',
'year': 2001}
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-29 18:49:48 [auto1.de] INFO: Saving data for XT21551: {'auction_closing_time': 1774886063.0, 'created_time': 1774033653.9239, 'last_price_update_time': 1774810188.860837}
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT21551') HTTP/1.1" 204 0
2026-03-29 18:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702
2026-03-29 18:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702
2026-03-29 18:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57aee205-5c9c-5e64-b445-02144e19996f with identifier: RT47702 to the API
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:09:56Z',
'fuel_type': 'petrol',
'id': '57aee205-5c9c-5e64-b445-02144e19996f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT47702',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 64123,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-28',
'seller_name': None,
'title': 'Renault Megane 1.2 TCe Energy Play',
'transmission': 'manual',
'trim': 'Play',
'year': 2018}
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-29 18:49:49 [auto1.de] INFO: Saving data for RT47702: {'auction_closing_time': 1774883396.0, 'created_time': 1774723592.403308, 'last_price_update_time': 1774810189.314855}
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT47702') HTTP/1.1" 204 0
2026-03-29 18:49:49 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-29 18:49:49 [auto1.de] INFO: Scrape type for KB45443: 2
2026-03-29 18:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443
2026-03-29 18:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17028070-e842-560a-84aa-3abdb5c90cb8 with scrape type 2
2026-03-29 18:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17028070-e842-560a-84aa-3abdb5c90cb8 with scrape type 2
2026-03-29 18:49:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17028070-e842-560a-84aa-3abdb5c90cb8, identifier: KB45443
2026-03-29 18:49:49 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-29 18:49:49 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-29 18:49:49 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-29 18:49:49 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-29 18:49:49 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-29 18:49:49 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-29 18:49:49 [auto1.de] INFO: Scrape type for BY26931: 2
2026-03-29 18:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931
2026-03-29 18:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with scrape type 2
2026-03-29 18:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with scrape type 2
2026-03-29 18:49:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25, identifier: BY26931
2026-03-29 18:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443
2026-03-29 18:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443
2026-03-29 18:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17028070-e842-560a-84aa-3abdb5c90cb8 with identifier: KB45443 to the API
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:45:01Z',
'fuel_type': 'diesel',
'id': '17028070-e842-560a-84aa-3abdb5c90cb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB45443',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 238537,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-28',
'seller_name': None,
'title': 'BMW 3er 320d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-29 18:49:49 [auto1.de] INFO: Saving data for KB45443: {'auction_closing_time': 1774885501.0, 'created_time': 1774723565.809008, 'last_price_update_time': 1774810189.819207}
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB45443') HTTP/1.1" 204 0
2026-03-29 18:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931
2026-03-29 18:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931
2026-03-29 18:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3e17ed1-4c2d-5272-b421-ecf43bfb7a25 with identifier: BY26931 to the API
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:40:46Z',
'fuel_type': 'diesel',
'id': 'a3e17ed1-4c2d-5272-b421-ecf43bfb7a25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY26931',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 98818,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-02-28',
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Beach',
'transmission': 'automatic',
'trim': 'Beach',
'year': 2018}
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-29 18:49:50 [auto1.de] INFO: Saving data for BY26931: {'auction_closing_time': 1774885246.0, 'created_time': 1774723574.173424, 'last_price_update_time': 1774810190.101268}
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY26931') HTTP/1.1" 204 0
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-29 18:49:50 [auto1.de] INFO: Scrape type for VA37364: 2
2026-03-29 18:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364
2026-03-29 18:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with scrape type 2
2026-03-29 18:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with scrape type 2
2026-03-29 18:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e, identifier: VA37364
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-29 18:49:50 [auto1.de] INFO: Scrape type for MV86263: 2
2026-03-29 18:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263
2026-03-29 18:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e91f2a0-6c81-5c36-beb2-0671751650dc with scrape type 2
2026-03-29 18:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e91f2a0-6c81-5c36-beb2-0671751650dc with scrape type 2
2026-03-29 18:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e91f2a0-6c81-5c36-beb2-0671751650dc, identifier: MV86263
2026-03-29 18:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364
2026-03-29 18:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364
2026-03-29 18:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90b17a01-899b-5bcf-bb76-8fa88f6ec06e with identifier: VA37364 to the API
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:46:55Z',
'fuel_type': 'petrol',
'id': '90b17a01-899b-5bcf-bb76-8fa88f6ec06e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA37364',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 192955,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-29',
'seller_name': None,
'title': 'BMW 3er 330i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2015}
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-29 18:49:50 [auto1.de] INFO: Saving data for VA37364: {'auction_closing_time': 1774885615.0, 'created_time': 1774035024.781025, 'last_price_update_time': 1774810190.592966}
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA37364') HTTP/1.1" 204 0
2026-03-29 18:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263
2026-03-29 18:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263
2026-03-29 18:49:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e91f2a0-6c81-5c36-beb2-0671751650dc with identifier: MV86263 to the API
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:39:15Z',
'fuel_type': 'diesel',
'id': '6e91f2a0-6c81-5c36-beb2-0671751650dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV86263',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 170303,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-30',
'seller_name': None,
'title': 'BMW 3er 320d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-29 18:49:50 [auto1.de] INFO: Saving data for MV86263: {'auction_closing_time': 1774885155.0, 'created_time': 1773401365.117446, 'last_price_update_time': 1774810190.96829}
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV86263') HTTP/1.1" 204 0
2026-03-29 18:49:50 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-29 18:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-29 18:49:51 [auto1.de] INFO: Scrape type for CA66668: 2
2026-03-29 18:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668
2026-03-29 18:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c66bce0f-a39d-5a84-858e-ef07d2de88da with scrape type 2
2026-03-29 18:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c66bce0f-a39d-5a84-858e-ef07d2de88da with scrape type 2
2026-03-29 18:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c66bce0f-a39d-5a84-858e-ef07d2de88da, identifier: CA66668
2026-03-29 18:49:51 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-29 18:49:51 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-29 18:49:51 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-29 18:49:51 [auto1.de] INFO: Scrape type for MH61351: 2
2026-03-29 18:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351
2026-03-29 18:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dead19f4-b700-5b02-92a7-c6b43f572150 with scrape type 2
2026-03-29 18:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dead19f4-b700-5b02-92a7-c6b43f572150 with scrape type 2
2026-03-29 18:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dead19f4-b700-5b02-92a7-c6b43f572150, identifier: MH61351
2026-03-29 18:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668
2026-03-29 18:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668
2026-03-29 18:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c66bce0f-a39d-5a84-858e-ef07d2de88da with identifier: CA66668 to the API
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:10:31Z',
'fuel_type': 'diesel',
'id': 'c66bce0f-a39d-5a84-858e-ef07d2de88da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA66668',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 155472,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-25',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Edition',
'transmission': 'automatic',
'trim': 'lang BlueTEC Edition',
'year': 2017}
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-29 18:49:51 [auto1.de] INFO: Saving data for CA66668: {'auction_closing_time': 1774883431.0, 'created_time': 1774350797.248195, 'last_price_update_time': 1774810191.498575}
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA66668') HTTP/1.1" 204 0
2026-03-29 18:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351
2026-03-29 18:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351
2026-03-29 18:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dead19f4-b700-5b02-92a7-c6b43f572150 with identifier: MH61351 to the API
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 380,
'expiration_date': '2026-03-30T15:41:48Z',
'fuel_type': 'petrol',
'id': 'dead19f4-b700-5b02-92a7-c6b43f572150',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH61351',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 91474,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-01',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2016}
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-29 18:49:51 [auto1.de] INFO: Saving data for MH61351: {'auction_closing_time': 1774885308.0, 'created_time': 1774350647.02296, 'last_price_update_time': 1774810191.788642}
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH61351') HTTP/1.1" 204 0
2026-03-29 18:49:51 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-29 18:49:51 [auto1.de] INFO: Scrape type for NZ98006: 2
2026-03-29 18:49:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006
2026-03-29 18:49:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with scrape type 2
2026-03-29 18:49:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with scrape type 2
2026-03-29 18:49:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0, identifier: NZ98006
2026-03-29 18:49:51 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-29 18:49:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006
2026-03-29 18:49:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006
2026-03-29 18:49:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0 with identifier: NZ98006 to the API
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:23:39Z',
'fuel_type': 'petrol',
'id': '8d7fbfad-2fa3-5cd0-9e5e-d87b4066d1a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ98006',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 188210,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-25',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-29 18:49:52 [auto1.de] INFO: Saving data for NZ98006: {'auction_closing_time': 1774884219.0, 'created_time': 1774723643.926992, 'last_price_update_time': 1774810192.185614}
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ98006') HTTP/1.1" 204 0
2026-03-29 18:49:52 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-29 18:49:52 [auto1.de] INFO: Scrape type for MP14986: 2
2026-03-29 18:49:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986
2026-03-29 18:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbec23ff-f10f-568f-8aca-93619b9d2662 with scrape type 2
2026-03-29 18:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbec23ff-f10f-568f-8aca-93619b9d2662 with scrape type 2
2026-03-29 18:49:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbec23ff-f10f-568f-8aca-93619b9d2662, identifier: MP14986
2026-03-29 18:49:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986
2026-03-29 18:49:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986
2026-03-29 18:49:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbec23ff-f10f-568f-8aca-93619b9d2662 with identifier: MP14986 to the API
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:29Z',
'fuel_type': 'petrol',
'id': 'cbec23ff-f10f-568f-8aca-93619b9d2662',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP14986',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 114148,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-15',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2018}
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-29 18:49:52 [auto1.de] INFO: Saving data for MP14986: {'auction_closing_time': 1774883069.0, 'created_time': 1774723630.062835, 'last_price_update_time': 1774810192.581206}
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP14986') HTTP/1.1" 204 0
2026-03-29 18:49:52 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-29 18:49:52 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-29 18:49:52 [auto1.de] INFO: Scrape type for KU30255: 2
2026-03-29 18:49:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255
2026-03-29 18:49:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84a50185-5451-56a3-9f06-f298d2ef3895 with scrape type 2
2026-03-29 18:49:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84a50185-5451-56a3-9f06-f298d2ef3895 with scrape type 2
2026-03-29 18:49:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84a50185-5451-56a3-9f06-f298d2ef3895, identifier: KU30255
2026-03-29 18:49:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255
2026-03-29 18:49:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255
2026-03-29 18:49:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84a50185-5451-56a3-9f06-f298d2ef3895 with identifier: KU30255 to the API
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:43:53Z',
'fuel_type': 'petrol',
'id': '84a50185-5451-56a3-9f06-f298d2ef3895',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU30255',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 78242,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-27',
'seller_name': None,
'title': 'BMW 3er 318i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2019}
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-29 18:49:52 [auto1.de] INFO: Saving data for KU30255: {'auction_closing_time': 1774885433.0, 'created_time': 1774119113.137145, 'last_price_update_time': 1774810192.984377}
2026-03-29 18:49:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU30255') HTTP/1.1" 204 0
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-29 18:49:53 [auto1.de] INFO: Scrape type for TM08126: 2
2026-03-29 18:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126
2026-03-29 18:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d81404-a69a-5e91-a69e-19f501055c15 with scrape type 2
2026-03-29 18:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d81404-a69a-5e91-a69e-19f501055c15 with scrape type 2
2026-03-29 18:49:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8d81404-a69a-5e91-a69e-19f501055c15, identifier: TM08126
2026-03-29 18:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126
2026-03-29 18:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126
2026-03-29 18:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8d81404-a69a-5e91-a69e-19f501055c15 with identifier: TM08126 to the API
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:48:33Z',
'fuel_type': 'diesel',
'id': 'f8d81404-a69a-5e91-a69e-19f501055c15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM08126',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 127279,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-21',
'seller_name': None,
'title': 'BMW X3 xDrive 20d xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2018}
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-29 18:49:53 [auto1.de] INFO: Saving data for TM08126: {'auction_closing_time': 1774885713.0, 'created_time': 1773429456.033002, 'last_price_update_time': 1774810193.410431}
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM08126') HTTP/1.1" 204 0
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-29 18:49:53 [auto1.de] INFO: Scrape type for JG89144: 2
2026-03-29 18:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144
2026-03-29 18:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with scrape type 2
2026-03-29 18:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with scrape type 2
2026-03-29 18:49:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b, identifier: JG89144
2026-03-29 18:49:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144
2026-03-29 18:49:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144
2026-03-29 18:49:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b with identifier: JG89144 to the API
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 188,
'expiration_date': '2026-03-30T15:12:19Z',
'fuel_type': 'hybrid',
'id': '54495e1b-c8c8-58e0-ad2b-c1caa0e5e73b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG89144',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 74429,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-18',
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus 4WD',
'transmission': 'automatic',
'trim': 'Plus 4WD',
'year': 2022}
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-29 18:49:53 [auto1.de] INFO: Saving data for JG89144: {'auction_closing_time': 1774883539.0, 'created_time': 1774350514.422468, 'last_price_update_time': 1774810193.907545}
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG89144') HTTP/1.1" 204 0
2026-03-29 18:49:53 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 6740 | hits on page: 40
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-29 18:49:53 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-29 18:49:53 [auto1.de] INFO: Scrape type for NT23997: 2
2026-03-29 18:49:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997
2026-03-29 18:49:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373fad9d-b29b-5c67-a972-8aaf4a831613 with scrape type 2
2026-03-29 18:49:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 373fad9d-b29b-5c67-a972-8aaf4a831613 with scrape type 2
2026-03-29 18:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 373fad9d-b29b-5c67-a972-8aaf4a831613, identifier: NT23997
2026-03-29 18:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997
2026-03-29 18:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997
2026-03-29 18:49:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 373fad9d-b29b-5c67-a972-8aaf4a831613 with identifier: NT23997 to the API
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:03:07Z',
'fuel_type': 'petrol',
'id': '373fad9d-b29b-5c67-a972-8aaf4a831613',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT23997',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 31835,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seller_name': None,
'title': 'Audi Q2 35 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-29 18:49:54 [auto1.de] INFO: Saving data for NT23997: {'auction_closing_time': 1774882987.0, 'created_time': 1774034818.10009, 'last_price_update_time': 1774810194.312072}
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT23997') HTTP/1.1" 204 0
2026-03-29 18:49:54 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-29 18:49:54 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-29 18:49:54 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-29 18:49:54 [auto1.de] INFO: Scrape type for XX85358: 2
2026-03-29 18:49:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358
2026-03-29 18:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with scrape type 2
2026-03-29 18:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with scrape type 2
2026-03-29 18:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af, identifier: XX85358
2026-03-29 18:49:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:49:54 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-29 18:49:54 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-29 18:49:54 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-29 18:49:54 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-29 18:49:54 [auto1.de] INFO: Scrape type for LX07481: 2
2026-03-29 18:49:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481
2026-03-29 18:49:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7adc4e39-9198-592d-88fe-4a375358a9ad with scrape type 2
2026-03-29 18:49:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7adc4e39-9198-592d-88fe-4a375358a9ad with scrape type 2
2026-03-29 18:49:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7adc4e39-9198-592d-88fe-4a375358a9ad, identifier: LX07481
2026-03-29 18:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358
2026-03-29 18:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358
2026-03-29 18:49:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb189dbb-f026-52c1-9eb2-6b9a78a2e9af with identifier: XX85358 to the API
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 239,
'expiration_date': '2026-03-30T15:34:47Z',
'fuel_type': 'diesel',
'id': 'bb189dbb-f026-52c1-9eb2-6b9a78a2e9af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX85358',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 117753,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-02',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 300 d 4MATIC EDITION lang',
'transmission': 'automatic',
'trim': '4MATIC EDITION lang',
'year': 2019}
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-29 18:49:54 [auto1.de] INFO: Saving data for XX85358: {'auction_closing_time': 1774884887.0, 'created_time': 1773134522.714017, 'last_price_update_time': 1774810194.839077}
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX85358') HTTP/1.1" 204 0
2026-03-29 18:49:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481
2026-03-29 18:49:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481
2026-03-29 18:49:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7adc4e39-9198-592d-88fe-4a375358a9ad with identifier: LX07481 to the API
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:23:39Z',
'fuel_type': 'petrol',
'id': '7adc4e39-9198-592d-88fe-4a375358a9ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX07481',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 118523,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-12',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2012}
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-29 18:49:55 [auto1.de] INFO: Saving data for LX07481: {'auction_closing_time': 1774884219.0, 'created_time': 1774723584.864866, 'last_price_update_time': 1774810195.22766}
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX07481') HTTP/1.1" 204 0
2026-03-29 18:49:55 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-29 18:49:55 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-29 18:49:55 [auto1.de] INFO: Scrape type for NY40403: 2
2026-03-29 18:49:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403
2026-03-29 18:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ff7838-b2a4-5758-8a06-5e2839ec489e with scrape type 2
2026-03-29 18:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ff7838-b2a4-5758-8a06-5e2839ec489e with scrape type 2
2026-03-29 18:49:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ff7838-b2a4-5758-8a06-5e2839ec489e, identifier: NY40403
2026-03-29 18:49:55 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-29 18:49:55 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-29 18:49:55 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-29 18:49:55 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-29 18:49:55 [auto1.de] INFO: Scrape type for XE09172: 2
2026-03-29 18:49:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172
2026-03-29 18:49:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with scrape type 2
2026-03-29 18:49:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with scrape type 2
2026-03-29 18:49:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f, identifier: XE09172
2026-03-29 18:49:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403
2026-03-29 18:49:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403
2026-03-29 18:49:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ff7838-b2a4-5758-8a06-5e2839ec489e with identifier: NY40403 to the API
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:01:21Z',
'fuel_type': 'petrol',
'id': '72ff7838-b2a4-5758-8a06-5e2839ec489e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY40403',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 164338,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-18',
'seller_name': None,
'title': 'Opel Corsa 1.4 Satellite',
'transmission': 'manual',
'trim': 'Satellite',
'year': 2011}
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-29 18:49:55 [auto1.de] INFO: Saving data for NY40403: {'auction_closing_time': 1774882881.0, 'created_time': 1773429629.778053, 'last_price_update_time': 1774810195.745479}
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY40403') HTTP/1.1" 204 0
2026-03-29 18:49:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172
2026-03-29 18:49:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172
2026-03-29 18:49:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e08ae0-dd15-5f34-a1ee-77fb71e2558f with identifier: XE09172 to the API
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:24:16Z',
'fuel_type': 'petrol',
'id': '02e08ae0-dd15-5f34-a1ee-77fb71e2558f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE09172',
'listing': 'auction',
'make': 'Peugeot',
'model': '107',
'odometer': 83684,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-15',
'seller_name': None,
'title': 'Peugeot 107 1.0 Filou',
'transmission': 'automatic',
'trim': 'Filou',
'year': 2009}
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-29 18:49:56 [auto1.de] INFO: Saving data for XE09172: {'auction_closing_time': 1774884256.0, 'created_time': 1774723706.412985, 'last_price_update_time': 1774810196.034673}
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE09172') HTTP/1.1" 204 0
2026-03-29 18:49:56 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-29 18:49:56 [auto1.de] INFO: Scrape type for JY99626: 2
2026-03-29 18:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626
2026-03-29 18:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f89c88-dfc3-5350-af06-7828b253e018 with scrape type 2
2026-03-29 18:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3f89c88-dfc3-5350-af06-7828b253e018 with scrape type 2
2026-03-29 18:49:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3f89c88-dfc3-5350-af06-7828b253e018, identifier: JY99626
2026-03-29 18:49:56 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-29 18:49:56 [auto1.de] INFO: Scrape type for ST78231: 2
2026-03-29 18:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231
2026-03-29 18:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43660542-0239-5791-b2d9-5bb568d20e7a with scrape type 2
2026-03-29 18:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43660542-0239-5791-b2d9-5bb568d20e7a with scrape type 2
2026-03-29 18:49:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43660542-0239-5791-b2d9-5bb568d20e7a, identifier: ST78231
2026-03-29 18:49:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626
2026-03-29 18:49:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626
2026-03-29 18:49:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3f89c88-dfc3-5350-af06-7828b253e018 with identifier: JY99626 to the API
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:12:14Z',
'fuel_type': 'diesel',
'id': 'f3f89c88-dfc3-5350-af06-7828b253e018',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY99626',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 154046,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-06',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2013}
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-29 18:49:56 [auto1.de] INFO: Saving data for JY99626: {'auction_closing_time': 1774883534.0, 'created_time': 1774723582.638211, 'last_price_update_time': 1774810196.538694}
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY99626') HTTP/1.1" 204 0
2026-03-29 18:49:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231
2026-03-29 18:49:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231
2026-03-29 18:49:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43660542-0239-5791-b2d9-5bb568d20e7a with identifier: ST78231 to the API
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:50:31Z',
'fuel_type': 'petrol',
'id': '43660542-0239-5791-b2d9-5bb568d20e7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST78231',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 68760,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-16',
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion Tech',
'year': 2017}
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-29 18:49:56 [auto1.de] INFO: Saving data for ST78231: {'auction_closing_time': 1774885831.0, 'created_time': 1774723607.37564, 'last_price_update_time': 1774810196.895814}
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST78231') HTTP/1.1" 204 0
2026-03-29 18:49:56 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-29 18:49:56 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-29 18:49:56 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-29 18:49:56 [auto1.de] INFO: Scrape type for MA20139: 2
2026-03-29 18:49:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139
2026-03-29 18:49:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with scrape type 2
2026-03-29 18:49:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with scrape type 2
2026-03-29 18:49:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1, identifier: MA20139
2026-03-29 18:49:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139
2026-03-29 18:49:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139
2026-03-29 18:49:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 623c40d0-ce85-56e7-89e2-eb4d46ee2cc1 with identifier: MA20139 to the API
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 235,
'expiration_date': '2026-03-30T15:34:41Z',
'fuel_type': 'diesel',
'id': '623c40d0-ce85-56e7-89e2-eb4d46ee2cc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA20139',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 228052,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-23',
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-29 18:49:57 [auto1.de] INFO: Saving data for MA20139: {'auction_closing_time': 1774884881.0, 'created_time': 1774723568.874525, 'last_price_update_time': 1774810197.288752}
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA20139') HTTP/1.1" 204 0
2026-03-29 18:49:57 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-29 18:49:57 [auto1.de] INFO: Scrape type for GK17224: 2
2026-03-29 18:49:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224
2026-03-29 18:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb98a53-7a1a-5938-8404-a38b8206175c with scrape type 2
2026-03-29 18:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbb98a53-7a1a-5938-8404-a38b8206175c with scrape type 2
2026-03-29 18:49:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbb98a53-7a1a-5938-8404-a38b8206175c, identifier: GK17224
2026-03-29 18:49:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224
2026-03-29 18:49:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224
2026-03-29 18:49:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbb98a53-7a1a-5938-8404-a38b8206175c with identifier: GK17224 to the API
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:09:42Z',
'fuel_type': 'diesel',
'id': 'fbb98a53-7a1a-5938-8404-a38b8206175c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK17224',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 231020,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-30',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'automatic',
'trim': 'GTD BlueMotion Tech',
'year': 2014}
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-29 18:49:57 [auto1.de] INFO: Saving data for GK17224: {'auction_closing_time': 1774883382.0, 'created_time': 1774723702.843296, 'last_price_update_time': 1774810197.77502}
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK17224') HTTP/1.1" 204 0
2026-03-29 18:49:57 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-29 18:49:57 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE16613%27 HTTP/1.1" 200 None
2026-03-29 18:49:57 [auto1.de] INFO: Scrape type for CE16613: 2
2026-03-29 18:49:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613
2026-03-29 18:49:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with scrape type 2
2026-03-29 18:49:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with scrape type 2
2026-03-29 18:49:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9, identifier: CE16613
2026-03-29 18:49:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613
2026-03-29 18:49:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613
2026-03-29 18:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7b4f369-22a1-51b8-afe7-f5c9e85f95b9 with identifier: CE16613 to the API
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:17:45Z',
'fuel_type': 'diesel',
'id': 'e7b4f369-22a1-51b8-afe7-f5c9e85f95b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE16613',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 180848,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-30',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 CRDi Pure 2WD',
'transmission': 'automatic',
'trim': 'Pure 2WD',
'year': 2018}
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE16613%27 HTTP/1.1" 200 None
2026-03-29 18:49:58 [auto1.de] INFO: Saving data for CE16613: {'auction_closing_time': 1774883865.0, 'created_time': 1773382196.307138, 'last_price_update_time': 1774810198.189286}
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE16613') HTTP/1.1" 204 0
2026-03-29 18:49:58 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK16963%27 HTTP/1.1" 200 None
2026-03-29 18:49:58 [auto1.de] INFO: Scrape type for AK16963: 2
2026-03-29 18:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963
2026-03-29 18:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c285e17-d0e8-59db-9108-bc37c27bf963 with scrape type 2
2026-03-29 18:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c285e17-d0e8-59db-9108-bc37c27bf963 with scrape type 2
2026-03-29 18:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c285e17-d0e8-59db-9108-bc37c27bf963, identifier: AK16963
2026-03-29 18:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963
2026-03-29 18:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963
2026-03-29 18:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c285e17-d0e8-59db-9108-bc37c27bf963 with identifier: AK16963 to the API
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:50:53Z',
'fuel_type': 'petrol',
'id': '3c285e17-d0e8-59db-9108-bc37c27bf963',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK16963',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 165694,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-07-22',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2008}
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK16963%27 HTTP/1.1" 200 None
2026-03-29 18:49:58 [auto1.de] INFO: Saving data for AK16963: {'auction_closing_time': 1774885853.0, 'created_time': 1774723581.218419, 'last_price_update_time': 1774810198.574275}
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK16963') HTTP/1.1" 204 0
2026-03-29 18:49:58 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG11291%27 HTTP/1.1" 200 None
2026-03-29 18:49:58 [auto1.de] INFO: Scrape type for PG11291: 2
2026-03-29 18:49:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291
2026-03-29 18:49:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with scrape type 2
2026-03-29 18:49:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with scrape type 2
2026-03-29 18:49:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f, identifier: PG11291
2026-03-29 18:49:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291
2026-03-29 18:49:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291
2026-03-29 18:49:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f00cec89-06e9-5cfd-9204-0cecaa1d8f3f with identifier: PG11291 to the API
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:49:27Z',
'fuel_type': 'diesel',
'id': 'f00cec89-06e9-5cfd-9204-0cecaa1d8f3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG11291',
'listing': 'auction',
'make': 'Audi',
'model': 'Q5',
'odometer': 240549,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-06',
'seller_name': None,
'title': 'Audi Q5 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG11291%27 HTTP/1.1" 200 None
2026-03-29 18:49:58 [auto1.de] INFO: Saving data for PG11291: {'auction_closing_time': 1774885767.0, 'created_time': 1773382957.371469, 'last_price_update_time': 1774810198.984016}
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG11291') HTTP/1.1" 204 0
2026-03-29 18:49:59 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE64708%27 HTTP/1.1" 200 None
2026-03-29 18:49:59 [auto1.de] INFO: Scrape type for HE64708: 2
2026-03-29 18:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708
2026-03-29 18:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with scrape type 2
2026-03-29 18:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with scrape type 2
2026-03-29 18:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2, identifier: HE64708
2026-03-29 18:49:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:49:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708
2026-03-29 18:49:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708
2026-03-29 18:49:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2 with identifier: HE64708 to the API
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:16:28Z',
'fuel_type': 'diesel',
'id': '9fc7aa04-f3d0-59ff-8d4a-8f4eb84673e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE64708',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 175526,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-07',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Alltrack BlueMotion',
'transmission': 'manual',
'trim': 'Alltrack BlueMotion',
'year': 2017}
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE64708%27 HTTP/1.1" 200 None
2026-03-29 18:49:59 [auto1.de] INFO: Saving data for HE64708: {'auction_closing_time': 1774883788.0, 'created_time': 1774723578.802939, 'last_price_update_time': 1774810199.385208}
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE64708') HTTP/1.1" 204 0
2026-03-29 18:49:59 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK51432%27 HTTP/1.1" 200 None
2026-03-29 18:49:59 [auto1.de] INFO: Scrape type for ZK51432: 2
2026-03-29 18:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432
2026-03-29 18:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b6992e-5985-5e4d-acaf-b4adf17967a3 with scrape type 2
2026-03-29 18:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28b6992e-5985-5e4d-acaf-b4adf17967a3 with scrape type 2
2026-03-29 18:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28b6992e-5985-5e4d-acaf-b4adf17967a3, identifier: ZK51432
2026-03-29 18:49:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432
2026-03-29 18:49:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432
2026-03-29 18:49:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28b6992e-5985-5e4d-acaf-b4adf17967a3 with identifier: ZK51432 to the API
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:49:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:03:40Z',
'fuel_type': 'diesel',
'id': '28b6992e-5985-5e4d-acaf-b4adf17967a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51432',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 278791,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-01',
'seller_name': None,
'title': 'Nissan Qashqai 1.6 dCi Tekna',
'transmission': 'automatic',
'trim': 'Tekna',
'year': 2015}
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK51432%27 HTTP/1.1" 200 None
2026-03-29 18:49:59 [auto1.de] INFO: Saving data for ZK51432: {'auction_closing_time': 1774883020.0, 'created_time': 1773429036.749465, 'last_price_update_time': 1774810199.779063}
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK51432') HTTP/1.1" 204 0
2026-03-29 18:49:59 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-29 18:49:59 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU28029%27 HTTP/1.1" 200 None
2026-03-29 18:49:59 [auto1.de] INFO: Scrape type for JU28029: 2
2026-03-29 18:49:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029
2026-03-29 18:49:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with scrape type 2
2026-03-29 18:49:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with scrape type 2
2026-03-29 18:49:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a, identifier: JU28029
2026-03-29 18:49:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029
2026-03-29 18:49:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029
2026-03-29 18:49:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e4b264-951e-5bd4-b4b6-b21c0ec96c7a with identifier: JU28029 to the API
2026-03-29 18:49:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:57:19Z',
'fuel_type': 'petrol',
'id': '89e4b264-951e-5bd4-b4b6-b21c0ec96c7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU28029',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 71643,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-28',
'seller_name': None,
'title': 'Ford Mondeo 1.5 EcoBoost Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2019}
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU28029%27 HTTP/1.1" 200 None
2026-03-29 18:50:00 [auto1.de] INFO: Saving data for JU28029: {'auction_closing_time': 1774886239.0, 'created_time': 1774723577.377706, 'last_price_update_time': 1774810200.218436}
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU28029') HTTP/1.1" 204 0
2026-03-29 18:50:00 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:00 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-29 18:50:00 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE75867%27 HTTP/1.1" 200 None
2026-03-29 18:50:00 [auto1.de] INFO: Scrape type for BE75867: 2
2026-03-29 18:50:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867
2026-03-29 18:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with scrape type 2
2026-03-29 18:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with scrape type 2
2026-03-29 18:50:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39, identifier: BE75867
2026-03-29 18:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867
2026-03-29 18:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867
2026-03-29 18:50:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b6386c4-2313-5b3b-a4e6-a7f17404fc39 with identifier: BE75867 to the API
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:34:11Z',
'fuel_type': 'diesel',
'id': '9b6386c4-2313-5b3b-a4e6-a7f17404fc39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE75867',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito Tourer',
'odometer': 113154,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-17',
'seller_name': None,
'title': 'Mercedes-Benz Vito Tourer 119 CDI Select lang',
'transmission': 'automatic',
'trim': 'Select lang',
'year': 2020}
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE75867%27 HTTP/1.1" 200 None
2026-03-29 18:50:00 [auto1.de] INFO: Saving data for BE75867: {'auction_closing_time': 1774884851.0, 'created_time': 1774723568.513085, 'last_price_update_time': 1774810200.621369}
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE75867') HTTP/1.1" 204 0
2026-03-29 18:50:00 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-29 18:50:00 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-29 18:50:00 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK18000%27 HTTP/1.1" 200 None
2026-03-29 18:50:00 [auto1.de] INFO: Scrape type for VK18000: 2
2026-03-29 18:50:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000
2026-03-29 18:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27cc3358-c343-58b8-b89e-c8a05a9677f4 with scrape type 2
2026-03-29 18:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27cc3358-c343-58b8-b89e-c8a05a9677f4 with scrape type 2
2026-03-29 18:50:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27cc3358-c343-58b8-b89e-c8a05a9677f4, identifier: VK18000
2026-03-29 18:50:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:00 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-29 18:50:00 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56642%27 HTTP/1.1" 200 None
2026-03-29 18:50:00 [auto1.de] INFO: Scrape type for KV56642: 2
2026-03-29 18:50:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642
2026-03-29 18:50:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bf31179-041e-5a4b-87ac-904f27db6764 with scrape type 2
2026-03-29 18:50:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bf31179-041e-5a4b-87ac-904f27db6764 with scrape type 2
2026-03-29 18:50:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bf31179-041e-5a4b-87ac-904f27db6764, identifier: KV56642
2026-03-29 18:50:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000
2026-03-29 18:50:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000
2026-03-29 18:50:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27cc3358-c343-58b8-b89e-c8a05a9677f4 with identifier: VK18000 to the API
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:15:41Z',
'fuel_type': 'diesel',
'id': '27cc3358-c343-58b8-b89e-c8a05a9677f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK18000',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 262433,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-31',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2017}
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK18000%27 HTTP/1.1" 200 None
2026-03-29 18:50:01 [auto1.de] INFO: Saving data for VK18000: {'auction_closing_time': 1774883741.0, 'created_time': 1774723590.08805, 'last_price_update_time': 1774810201.253794}
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK18000') HTTP/1.1" 204 0
2026-03-29 18:50:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642
2026-03-29 18:50:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642
2026-03-29 18:50:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bf31179-041e-5a4b-87ac-904f27db6764 with identifier: KV56642 to the API
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:04:34Z',
'fuel_type': 'diesel',
'id': '3bf31179-041e-5a4b-87ac-904f27db6764',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV56642',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 33859,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-17',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2022}
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56642%27 HTTP/1.1" 200 None
2026-03-29 18:50:01 [auto1.de] INFO: Saving data for KV56642: {'auction_closing_time': 1774883074.0, 'created_time': 1774723561.930063, 'last_price_update_time': 1774810201.585915}
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV56642') HTTP/1.1" 204 0
2026-03-29 18:50:01 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ88951%27 HTTP/1.1" 200 None
2026-03-29 18:50:01 [auto1.de] INFO: Scrape type for ZJ88951: 2
2026-03-29 18:50:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951
2026-03-29 18:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with scrape type 2
2026-03-29 18:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with scrape type 2
2026-03-29 18:50:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7, identifier: ZJ88951
2026-03-29 18:50:01 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-29 18:50:01 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU41188%27 HTTP/1.1" 200 None
2026-03-29 18:50:01 [auto1.de] INFO: Scrape type for ZU41188: 2
2026-03-29 18:50:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188
2026-03-29 18:50:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0b8bf2-ccaa-5116-9216-647e1db47f82 with scrape type 2
2026-03-29 18:50:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0b8bf2-ccaa-5116-9216-647e1db47f82 with scrape type 2
2026-03-29 18:50:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd0b8bf2-ccaa-5116-9216-647e1db47f82, identifier: ZU41188
2026-03-29 18:50:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951
2026-03-29 18:50:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951
2026-03-29 18:50:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7 with identifier: ZJ88951 to the API
2026-03-29 18:50:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:47:15Z',
'fuel_type': 'petrol',
'id': '0cdb04b4-2524-5c21-a8c6-c3a553eb7dd7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ88951',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 152059,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-05-26',
'seller_name': None,
'title': 'BMW 3er 318i',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ88951%27 HTTP/1.1" 200 None
2026-03-29 18:50:02 [auto1.de] INFO: Saving data for ZJ88951: {'auction_closing_time': 1774885635.0, 'created_time': 1774723587.261736, 'last_price_update_time': 1774810202.15988}
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ88951') HTTP/1.1" 204 0
2026-03-29 18:50:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188
2026-03-29 18:50:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188
2026-03-29 18:50:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd0b8bf2-ccaa-5116-9216-647e1db47f82 with identifier: ZU41188 to the API
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:49:05Z',
'fuel_type': 'petrol',
'id': 'cd0b8bf2-ccaa-5116-9216-647e1db47f82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU41188',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 272567,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-15',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2009}
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU41188%27 HTTP/1.1" 200 None
2026-03-29 18:50:02 [auto1.de] INFO: Saving data for ZU41188: {'auction_closing_time': 1774885745.0, 'created_time': 1773429336.954809, 'last_price_update_time': 1774810202.450011}
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU41188') HTTP/1.1" 204 0
2026-03-29 18:50:02 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS51520%27 HTTP/1.1" 200 None
2026-03-29 18:50:02 [auto1.de] INFO: Scrape type for DS51520: 2
2026-03-29 18:50:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520
2026-03-29 18:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ce37e7-c50c-5026-b06b-ead22d09e5cb with scrape type 2
2026-03-29 18:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4ce37e7-c50c-5026-b06b-ead22d09e5cb with scrape type 2
2026-03-29 18:50:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4ce37e7-c50c-5026-b06b-ead22d09e5cb, identifier: DS51520
2026-03-29 18:50:02 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40849%27 HTTP/1.1" 200 None
2026-03-29 18:50:02 [auto1.de] INFO: Scrape type for VD40849: 2
2026-03-29 18:50:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849
2026-03-29 18:50:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ce504b-cf12-5d18-968f-8f13fa6023c6 with scrape type 2
2026-03-29 18:50:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ce504b-cf12-5d18-968f-8f13fa6023c6 with scrape type 2
2026-03-29 18:50:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20ce504b-cf12-5d18-968f-8f13fa6023c6, identifier: VD40849
2026-03-29 18:50:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520
2026-03-29 18:50:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520
2026-03-29 18:50:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4ce37e7-c50c-5026-b06b-ead22d09e5cb with identifier: DS51520 to the API
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:32:07Z',
'fuel_type': 'petrol',
'id': 'a4ce37e7-c50c-5026-b06b-ead22d09e5cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS51520',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 168260,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-26',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TSI Monte Carlo',
'transmission': 'manual',
'trim': 'Monte Carlo',
'year': 2014}
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS51520%27 HTTP/1.1" 200 None
2026-03-29 18:50:02 [auto1.de] INFO: Saving data for DS51520: {'auction_closing_time': 1774884727.0, 'created_time': 1774723565.205552, 'last_price_update_time': 1774810202.976823}
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS51520') HTTP/1.1" 204 0
2026-03-29 18:50:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849
2026-03-29 18:50:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849
2026-03-29 18:50:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20ce504b-cf12-5d18-968f-8f13fa6023c6 with identifier: VD40849 to the API
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-30T15:35:32Z',
'fuel_type': 'petrol',
'id': '20ce504b-cf12-5d18-968f-8f13fa6023c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD40849',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 100813,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-18',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
'transmission': 'automatic',
'trim': 'GTI TCR',
'year': 2019}
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40849%27 HTTP/1.1" 200 None
2026-03-29 18:50:03 [auto1.de] INFO: Saving data for VD40849: {'auction_closing_time': 1774884932.0, 'created_time': 1774723588.143818, 'last_price_update_time': 1774810203.273164}
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD40849') HTTP/1.1" 204 0
2026-03-29 18:50:03 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-29 18:50:03 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-29 18:50:03 [auto1.de] INFO: Scrape type for AX34662: 2
2026-03-29 18:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662
2026-03-29 18:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57040be-5764-5b31-ac27-bf01704e375b with scrape type 2
2026-03-29 18:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f57040be-5764-5b31-ac27-bf01704e375b with scrape type 2
2026-03-29 18:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f57040be-5764-5b31-ac27-bf01704e375b, identifier: AX34662
2026-03-29 18:50:03 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-29 18:50:03 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94641%27 HTTP/1.1" 200 None
2026-03-29 18:50:03 [auto1.de] INFO: Scrape type for ZA94641: 2
2026-03-29 18:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641
2026-03-29 18:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f1446a-413c-5264-8776-86bcef6ea39e with scrape type 2
2026-03-29 18:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4f1446a-413c-5264-8776-86bcef6ea39e with scrape type 2
2026-03-29 18:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4f1446a-413c-5264-8776-86bcef6ea39e, identifier: ZA94641
2026-03-29 18:50:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662
2026-03-29 18:50:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662
2026-03-29 18:50:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f57040be-5764-5b31-ac27-bf01704e375b with identifier: AX34662 to the API
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 147,
'expiration_date': '2026-03-30T15:59:58Z',
'fuel_type': 'petrol',
'id': 'f57040be-5764-5b31-ac27-bf01704e375b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX34662',
'listing': 'auction',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 172583,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-11-25',
'seller_name': None,
'title': 'Toyota Avensis 2.0 Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2004}
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-29 18:50:03 [auto1.de] INFO: Saving data for AX34662: {'auction_closing_time': 1774886398.0, 'created_time': 1774723606.748095, 'last_price_update_time': 1774810203.781545}
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX34662') HTTP/1.1" 204 0
2026-03-29 18:50:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641
2026-03-29 18:50:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641
2026-03-29 18:50:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4f1446a-413c-5264-8776-86bcef6ea39e with identifier: ZA94641 to the API
2026-03-29 18:50:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:42:22Z',
'fuel_type': 'diesel',
'id': 'f4f1446a-413c-5264-8776-86bcef6ea39e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA94641',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 362673,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-05',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 350 CDI T BlueEfficiency Elegance',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Elegance',
'year': 2013}
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94641%27 HTTP/1.1" 200 None
2026-03-29 18:50:04 [auto1.de] INFO: Saving data for ZA94641: {'auction_closing_time': 1774885342.0, 'created_time': 1774723656.52788, 'last_price_update_time': 1774810204.155941}
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA94641') HTTP/1.1" 204 0
2026-03-29 18:50:04 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32069%27 HTTP/1.1" 200 None
2026-03-29 18:50:04 [auto1.de] INFO: Scrape type for VP32069: 2
2026-03-29 18:50:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069
2026-03-29 18:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with scrape type 2
2026-03-29 18:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with scrape type 2
2026-03-29 18:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40, identifier: VP32069
2026-03-29 18:50:04 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL33228%27 HTTP/1.1" 200 None
2026-03-29 18:50:04 [auto1.de] INFO: Scrape type for YL33228: 2
2026-03-29 18:50:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228
2026-03-29 18:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039f92b0-a47d-513c-be79-1bdb93ea3dfd with scrape type 2
2026-03-29 18:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039f92b0-a47d-513c-be79-1bdb93ea3dfd with scrape type 2
2026-03-29 18:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039f92b0-a47d-513c-be79-1bdb93ea3dfd, identifier: YL33228
2026-03-29 18:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069
2026-03-29 18:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069
2026-03-29 18:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e97dbadf-cdfb-5357-a7c4-f5aacc0dab40 with identifier: VP32069 to the API
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:11:52Z',
'fuel_type': 'petrol',
'id': 'e97dbadf-cdfb-5357-a7c4-f5aacc0dab40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP32069',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 24954,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-02',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 200 Mild-Hybrid Progressive',
'transmission': 'automatic',
'trim': 'Progressive',
'year': 2022}
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32069%27 HTTP/1.1" 200 None
2026-03-29 18:50:04 [auto1.de] INFO: Saving data for VP32069: {'auction_closing_time': 1774883512.0, 'created_time': 1774723605.110484, 'last_price_update_time': 1774810204.687726}
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP32069') HTTP/1.1" 204 0
2026-03-29 18:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228
2026-03-29 18:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228
2026-03-29 18:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039f92b0-a47d-513c-be79-1bdb93ea3dfd with identifier: YL33228 to the API
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-30T15:10:55Z',
'fuel_type': 'diesel',
'id': '039f92b0-a47d-513c-be79-1bdb93ea3dfd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL33228',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 234778,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-05-19',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Soccer Trendline',
'transmission': 'manual',
'trim': 'Soccer Trendline',
'year': 2014}
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL33228%27 HTTP/1.1" 200 None
2026-03-29 18:50:05 [auto1.de] INFO: Saving data for YL33228: {'auction_closing_time': 1774883455.0, 'created_time': 1774723598.824145, 'last_price_update_time': 1774810205.04641}
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL33228') HTTP/1.1" 204 0
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU11253%27 HTTP/1.1" 200 None
2026-03-29 18:50:05 [auto1.de] INFO: Scrape type for ZU11253: 2
2026-03-29 18:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253
2026-03-29 18:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82298f8-bcc5-582a-8136-30fec9e4cead with scrape type 2
2026-03-29 18:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e82298f8-bcc5-582a-8136-30fec9e4cead with scrape type 2
2026-03-29 18:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e82298f8-bcc5-582a-8136-30fec9e4cead, identifier: ZU11253
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU87047%27 HTTP/1.1" 200 None
2026-03-29 18:50:05 [auto1.de] INFO: Scrape type for XU87047: 2
2026-03-29 18:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047
2026-03-29 18:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with scrape type 2
2026-03-29 18:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with scrape type 2
2026-03-29 18:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012, identifier: XU87047
2026-03-29 18:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253
2026-03-29 18:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253
2026-03-29 18:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e82298f8-bcc5-582a-8136-30fec9e4cead with identifier: ZU11253 to the API
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:17:25Z',
'fuel_type': 'petrol',
'id': 'e82298f8-bcc5-582a-8136-30fec9e4cead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU11253',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 65549,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-26',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.4 TSI Team',
'transmission': 'automatic',
'trim': 'Team',
'year': 2011}
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU11253%27 HTTP/1.1" 200 None
2026-03-29 18:50:05 [auto1.de] INFO: Saving data for ZU11253: {'auction_closing_time': 1774883845.0, 'created_time': 1774723606.369209, 'last_price_update_time': 1774810205.558155}
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU11253') HTTP/1.1" 204 0
2026-03-29 18:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047
2026-03-29 18:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047
2026-03-29 18:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 232f933d-bcce-5bd0-bdd5-1f0c6f66a012 with identifier: XU87047 to the API
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 333,
'expiration_date': '2026-03-30T15:34:07Z',
'fuel_type': 'petrol',
'id': '232f933d-bcce-5bd0-bdd5-1f0c6f66a012',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU87047',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 152626,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-16',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 400 CGI 4Matic Avantgarde',
'transmission': 'automatic',
'trim': '4Matic Avantgarde',
'year': 2013}
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU87047%27 HTTP/1.1" 200 None
2026-03-29 18:50:05 [auto1.de] INFO: Saving data for XU87047: {'auction_closing_time': 1774884847.0, 'created_time': 1774723609.253384, 'last_price_update_time': 1774810205.845791}
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU87047') HTTP/1.1" 204 0
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42692%27 HTTP/1.1" 200 None
2026-03-29 18:50:05 [auto1.de] INFO: Scrape type for FL42692: 2
2026-03-29 18:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692
2026-03-29 18:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with scrape type 2
2026-03-29 18:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with scrape type 2
2026-03-29 18:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324, identifier: FL42692
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-29 18:50:05 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW71090%27 HTTP/1.1" 200 None
2026-03-29 18:50:05 [auto1.de] INFO: Scrape type for GW71090: 2
2026-03-29 18:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090
2026-03-29 18:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58c3be50-9bc5-5850-b8d4-19b00c019d78 with scrape type 2
2026-03-29 18:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58c3be50-9bc5-5850-b8d4-19b00c019d78 with scrape type 2
2026-03-29 18:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58c3be50-9bc5-5850-b8d4-19b00c019d78, identifier: GW71090
2026-03-29 18:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692
2026-03-29 18:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692
2026-03-29 18:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324 with identifier: FL42692 to the API
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-30T15:18:44Z',
'fuel_type': 'petrol',
'id': '1e4d1ffe-e0ac-5cd5-a93b-009c36cd4324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL42692',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 111710,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-20',
'seller_name': None,
'title': 'Hyundai i20 1.2 Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2011}
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42692%27 HTTP/1.1" 200 None
2026-03-29 18:50:06 [auto1.de] INFO: Saving data for FL42692: {'auction_closing_time': 1774883924.0, 'created_time': 1774034207.713334, 'last_price_update_time': 1774810206.362042}
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL42692') HTTP/1.1" 204 0
2026-03-29 18:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090
2026-03-29 18:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090
2026-03-29 18:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58c3be50-9bc5-5850-b8d4-19b00c019d78 with identifier: GW71090 to the API
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:51:01Z',
'fuel_type': 'petrol',
'id': '58c3be50-9bc5-5850-b8d4-19b00c019d78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW71090',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 138088,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CGI T BlueEfficiency Elegance',
'transmission': 'manual',
'trim': 'T BlueEfficiency Elegance',
'year': 2012}
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW71090%27 HTTP/1.1" 200 None
2026-03-29 18:50:06 [auto1.de] INFO: Saving data for GW71090: {'auction_closing_time': 1774885861.0, 'created_time': 1774033896.424223, 'last_price_update_time': 1774810206.76007}
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW71090') HTTP/1.1" 204 0
2026-03-29 18:50:06 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-29 18:50:06 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP24311%27 HTTP/1.1" 200 None
2026-03-29 18:50:06 [auto1.de] INFO: Scrape type for EP24311: 2
2026-03-29 18:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311
2026-03-29 18:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with scrape type 2
2026-03-29 18:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with scrape type 2
2026-03-29 18:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25c17e22-9a09-5f02-90bf-bca8d077c6f1, identifier: EP24311
2026-03-29 18:50:06 [scrapy.extensions.logstats] INFO: Crawled 163 pages (at 7 pages/min), scraped 1574 items (at 140 items/min)
2026-03-29 18:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-29 18:50:06 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-29 18:50:06 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD59666%27 HTTP/1.1" 200 None
2026-03-29 18:50:06 [auto1.de] INFO: Scrape type for FD59666: 2
2026-03-29 18:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666
2026-03-29 18:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with scrape type 2
2026-03-29 18:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with scrape type 2
2026-03-29 18:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23d0b74e-10a0-5f6d-807a-8900e261a4e4, identifier: FD59666
2026-03-29 18:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311
2026-03-29 18:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311
2026-03-29 18:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25c17e22-9a09-5f02-90bf-bca8d077c6f1 with identifier: EP24311 to the API
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:55:09Z',
'fuel_type': 'diesel',
'id': '25c17e22-9a09-5f02-90bf-bca8d077c6f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP24311',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 191034,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-07-17',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2016}
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP24311%27 HTTP/1.1" 200 None
2026-03-29 18:50:07 [auto1.de] INFO: Saving data for EP24311: {'auction_closing_time': 1774886109.0, 'created_time': 1774034541.280974, 'last_price_update_time': 1774810207.260401}
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP24311') HTTP/1.1" 204 0
2026-03-29 18:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666
2026-03-29 18:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666
2026-03-29 18:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23d0b74e-10a0-5f6d-807a-8900e261a4e4 with identifier: FD59666 to the API
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:17:56Z',
'fuel_type': 'petrol',
'id': '23d0b74e-10a0-5f6d-807a-8900e261a4e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD59666',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 10285,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-03',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2020}
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD59666%27 HTTP/1.1" 200 None
2026-03-29 18:50:07 [auto1.de] INFO: Saving data for FD59666: {'auction_closing_time': 1774883876.0, 'created_time': 1774723572.285469, 'last_price_update_time': 1774810207.552478}
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD59666') HTTP/1.1" 204 0
2026-03-29 18:50:07 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-29 18:50:07 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-29 18:50:07 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05001%27 HTTP/1.1" 200 None
2026-03-29 18:50:07 [auto1.de] INFO: Scrape type for AX05001: 2
2026-03-29 18:50:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001
2026-03-29 18:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6a9820-49df-551e-95cf-ca254012fb68 with scrape type 2
2026-03-29 18:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6a9820-49df-551e-95cf-ca254012fb68 with scrape type 2
2026-03-29 18:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc6a9820-49df-551e-95cf-ca254012fb68, identifier: AX05001
2026-03-29 18:50:07 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-29 18:50:07 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39915%27 HTTP/1.1" 200 None
2026-03-29 18:50:07 [auto1.de] INFO: Scrape type for UW39915: 2
2026-03-29 18:50:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915
2026-03-29 18:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f80eb5e3-6431-5962-a7bc-f37fa17496ff with scrape type 2
2026-03-29 18:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f80eb5e3-6431-5962-a7bc-f37fa17496ff with scrape type 2
2026-03-29 18:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f80eb5e3-6431-5962-a7bc-f37fa17496ff, identifier: UW39915
2026-03-29 18:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001
2026-03-29 18:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001
2026-03-29 18:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc6a9820-49df-551e-95cf-ca254012fb68 with identifier: AX05001 to the API
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:18:49Z',
'fuel_type': 'diesel',
'id': 'bc6a9820-49df-551e-95cf-ca254012fb68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX05001',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 251476,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-14',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Classic',
'transmission': 'automatic',
'trim': 'BlueEfficiency Classic',
'year': 2013}
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05001%27 HTTP/1.1" 200 None
2026-03-29 18:50:08 [auto1.de] INFO: Saving data for AX05001: {'auction_closing_time': 1774883929.0, 'created_time': 1774350033.185443, 'last_price_update_time': 1774810208.080123}
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX05001') HTTP/1.1" 204 0
2026-03-29 18:50:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915
2026-03-29 18:50:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915
2026-03-29 18:50:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f80eb5e3-6431-5962-a7bc-f37fa17496ff with identifier: UW39915 to the API
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:47:10Z',
'fuel_type': 'petrol',
'id': 'f80eb5e3-6431-5962-a7bc-f37fa17496ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW39915',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 97356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-25',
'seller_name': None,
'title': 'Renault Twingo 0.9 Energy Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2018}
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39915%27 HTTP/1.1" 200 None
2026-03-29 18:50:08 [auto1.de] INFO: Saving data for UW39915: {'auction_closing_time': 1774885630.0, 'created_time': 1774723597.844809, 'last_price_update_time': 1774810208.374175}
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW39915') HTTP/1.1" 204 0
2026-03-29 18:50:08 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT27218%27 HTTP/1.1" 200 None
2026-03-29 18:50:08 [auto1.de] INFO: Scrape type for LT27218: 2
2026-03-29 18:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218
2026-03-29 18:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76e6e21b-71ab-549d-a300-05d206ce7541 with scrape type 2
2026-03-29 18:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76e6e21b-71ab-549d-a300-05d206ce7541 with scrape type 2
2026-03-29 18:50:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76e6e21b-71ab-549d-a300-05d206ce7541, identifier: LT27218
2026-03-29 18:50:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:08 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53202%27 HTTP/1.1" 200 None
2026-03-29 18:50:08 [auto1.de] INFO: Scrape type for GC53202: 2
2026-03-29 18:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202
2026-03-29 18:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f493106e-6d51-5e38-a23f-c7c6f4021320 with scrape type 2
2026-03-29 18:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f493106e-6d51-5e38-a23f-c7c6f4021320 with scrape type 2
2026-03-29 18:50:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f493106e-6d51-5e38-a23f-c7c6f4021320, identifier: GC53202
2026-03-29 18:50:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218
2026-03-29 18:50:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218
2026-03-29 18:50:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76e6e21b-71ab-549d-a300-05d206ce7541 with identifier: LT27218 to the API
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:05:18Z',
'fuel_type': 'petrol',
'id': '76e6e21b-71ab-549d-a300-05d206ce7541',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT27218',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 179594,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-09',
'seller_name': None,
'title': 'BMW 1er 116i',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT27218%27 HTTP/1.1" 200 None
2026-03-29 18:50:08 [auto1.de] INFO: Saving data for LT27218: {'auction_closing_time': 1774883118.0, 'created_time': 1774723601.791712, 'last_price_update_time': 1774810208.873471}
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT27218') HTTP/1.1" 204 0
2026-03-29 18:50:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202
2026-03-29 18:50:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202
2026-03-29 18:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f493106e-6d51-5e38-a23f-c7c6f4021320 with identifier: GC53202 to the API
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 80,
'expiration_date': '2026-03-30T15:52:59Z',
'fuel_type': 'diesel',
'id': 'f493106e-6d51-5e38-a23f-c7c6f4021320',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC53202',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 251780,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-13',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2008}
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53202%27 HTTP/1.1" 200 None
2026-03-29 18:50:09 [auto1.de] INFO: Saving data for GC53202: {'auction_closing_time': 1774885979.0, 'created_time': 1774723605.512404, 'last_price_update_time': 1774810209.237203}
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC53202') HTTP/1.1" 204 0
2026-03-29 18:50:09 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG23617%27 HTTP/1.1" 200 None
2026-03-29 18:50:09 [auto1.de] INFO: Scrape type for TG23617: 2
2026-03-29 18:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617
2026-03-29 18:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b36272d4-f016-51b1-bda0-5f905d11b176 with scrape type 2
2026-03-29 18:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b36272d4-f016-51b1-bda0-5f905d11b176 with scrape type 2
2026-03-29 18:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b36272d4-f016-51b1-bda0-5f905d11b176, identifier: TG23617
2026-03-29 18:50:09 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF84100%27 HTTP/1.1" 200 None
2026-03-29 18:50:09 [auto1.de] INFO: Scrape type for RF84100: 2
2026-03-29 18:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100
2026-03-29 18:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with scrape type 2
2026-03-29 18:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with scrape type 2
2026-03-29 18:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc, identifier: RF84100
2026-03-29 18:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617
2026-03-29 18:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617
2026-03-29 18:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b36272d4-f016-51b1-bda0-5f905d11b176 with identifier: TG23617 to the API
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:39:24Z',
'fuel_type': 'diesel',
'id': 'b36272d4-f016-51b1-bda0-5f905d11b176',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG23617',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 103298,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-01',
'seller_name': None,
'title': 'Peugeot 308 2.0 HDi Premium',
'transmission': 'manual',
'trim': 'Premium',
'year': 2009}
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG23617%27 HTTP/1.1" 200 None
2026-03-29 18:50:09 [auto1.de] INFO: Saving data for TG23617: {'auction_closing_time': 1774885164.0, 'created_time': 1774723615.053496, 'last_price_update_time': 1774810209.737067}
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG23617') HTTP/1.1" 204 0
2026-03-29 18:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100
2026-03-29 18:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100
2026-03-29 18:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6a20bb-8e47-55b5-a771-f23ea3483ecc with identifier: RF84100 to the API
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:18:45Z',
'fuel_type': 'diesel',
'id': '8a6a20bb-8e47-55b5-a771-f23ea3483ecc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF84100',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 267480,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-08',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2009}
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF84100%27 HTTP/1.1" 200 None
2026-03-29 18:50:10 [auto1.de] INFO: Saving data for RF84100: {'auction_closing_time': 1774883925.0, 'created_time': 1774723639.641006, 'last_price_update_time': 1774810210.01952}
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF84100') HTTP/1.1" 204 0
2026-03-29 18:50:10 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL01383%27 HTTP/1.1" 200 None
2026-03-29 18:50:10 [auto1.de] INFO: Scrape type for DL01383: 2
2026-03-29 18:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383
2026-03-29 18:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2455164e-0840-5ce2-b240-bc935f5ba72b with scrape type 2
2026-03-29 18:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2455164e-0840-5ce2-b240-bc935f5ba72b with scrape type 2
2026-03-29 18:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2455164e-0840-5ce2-b240-bc935f5ba72b, identifier: DL01383
2026-03-29 18:50:10 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:10 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW84058%27 HTTP/1.1" 200 None
2026-03-29 18:50:10 [auto1.de] INFO: Scrape type for BW84058: 2
2026-03-29 18:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058
2026-03-29 18:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da587257-26c9-5201-8a3a-06f0ddb6f3f6 with scrape type 2
2026-03-29 18:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da587257-26c9-5201-8a3a-06f0ddb6f3f6 with scrape type 2
2026-03-29 18:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da587257-26c9-5201-8a3a-06f0ddb6f3f6, identifier: BW84058
2026-03-29 18:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383
2026-03-29 18:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383
2026-03-29 18:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2455164e-0840-5ce2-b240-bc935f5ba72b with identifier: DL01383 to the API
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 87,
'expiration_date': '2026-03-30T15:46:10Z',
'fuel_type': 'petrol',
'id': '2455164e-0840-5ce2-b240-bc935f5ba72b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL01383',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 186264,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-18',
'seller_name': None,
'title': 'Opel Corsa 1.4 Color Edition',
'transmission': 'manual',
'trim': 'Color Edition',
'year': 2010}
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL01383%27 HTTP/1.1" 200 None
2026-03-29 18:50:10 [auto1.de] INFO: Saving data for DL01383: {'auction_closing_time': 1774885570.0, 'created_time': 1774723608.062685, 'last_price_update_time': 1774810210.654879}
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL01383') HTTP/1.1" 204 0
2026-03-29 18:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058
2026-03-29 18:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058
2026-03-29 18:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da587257-26c9-5201-8a3a-06f0ddb6f3f6 with identifier: BW84058 to the API
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:26:45Z',
'fuel_type': 'diesel',
'id': 'da587257-26c9-5201-8a3a-06f0ddb6f3f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW84058',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 115312,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-27',
'seller_name': None,
'title': 'Suzuki SX4 1.6 DDiS Comfort+ 4x4',
'transmission': 'manual',
'trim': 'Comfort+ 4x4',
'year': 2016}
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW84058%27 HTTP/1.1" 200 None
2026-03-29 18:50:10 [auto1.de] INFO: Saving data for BW84058: {'auction_closing_time': 1774884405.0, 'created_time': 1774723596.905144, 'last_price_update_time': 1774810210.945312}
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW84058') HTTP/1.1" 204 0
2026-03-29 18:50:10 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-29 18:50:10 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC68366%27 HTTP/1.1" 200 None
2026-03-29 18:50:10 [auto1.de] INFO: Scrape type for BC68366: 2
2026-03-29 18:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366
2026-03-29 18:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73cd456-3a47-5e5c-b96b-442fafff7a78 with scrape type 2
2026-03-29 18:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d73cd456-3a47-5e5c-b96b-442fafff7a78 with scrape type 2
2026-03-29 18:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d73cd456-3a47-5e5c-b96b-442fafff7a78, identifier: BC68366
2026-03-29 18:50:11 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX87227%27 HTTP/1.1" 200 None
2026-03-29 18:50:11 [auto1.de] INFO: Scrape type for NX87227: 2
2026-03-29 18:50:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227
2026-03-29 18:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a611312a-6fea-53ae-95c2-8c7e2fffb355 with scrape type 2
2026-03-29 18:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a611312a-6fea-53ae-95c2-8c7e2fffb355 with scrape type 2
2026-03-29 18:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a611312a-6fea-53ae-95c2-8c7e2fffb355, identifier: NX87227
2026-03-29 18:50:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:11 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ96014%27 HTTP/1.1" 200 None
2026-03-29 18:50:11 [auto1.de] INFO: Scrape type for WJ96014: 2
2026-03-29 18:50:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014
2026-03-29 18:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e8735f-10e7-50ca-afdd-1830a5164945 with scrape type 2
2026-03-29 18:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69e8735f-10e7-50ca-afdd-1830a5164945 with scrape type 2
2026-03-29 18:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69e8735f-10e7-50ca-afdd-1830a5164945, identifier: WJ96014
2026-03-29 18:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366
2026-03-29 18:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366
2026-03-29 18:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d73cd456-3a47-5e5c-b96b-442fafff7a78 with identifier: BC68366 to the API
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:13Z',
'fuel_type': 'diesel',
'id': 'd73cd456-3a47-5e5c-b96b-442fafff7a78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC68366',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Alfa GT',
'odometer': 304237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-29',
'seller_name': None,
'title': 'Alfa Romeo Alfa GT 1.9 JTD M-Jet Distinctive',
'transmission': 'manual',
'trim': 'M-Jet Distinctive',
'year': 2008}
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC68366%27 HTTP/1.1" 200 None
2026-03-29 18:50:11 [auto1.de] INFO: Saving data for BC68366: {'auction_closing_time': 1774883953.0, 'created_time': 1774723580.332695, 'last_price_update_time': 1774810211.563708}
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC68366') HTTP/1.1" 204 0
2026-03-29 18:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227
2026-03-29 18:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227
2026-03-29 18:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a611312a-6fea-53ae-95c2-8c7e2fffb355 with identifier: NX87227 to the API
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:59:55Z',
'fuel_type': 'petrol',
'id': 'a611312a-6fea-53ae-95c2-8c7e2fffb355',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX87227',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4',
'odometer': 157273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-26',
'seller_name': None,
'title': 'Suzuki SX4 1.6 Classic Style',
'transmission': 'manual',
'trim': 'Classic Style',
'year': 2013}
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX87227%27 HTTP/1.1" 200 None
2026-03-29 18:50:11 [auto1.de] INFO: Saving data for NX87227: {'auction_closing_time': 1774886395.0, 'created_time': 1773383484.851309, 'last_price_update_time': 1774810211.855978}
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX87227') HTTP/1.1" 204 0
2026-03-29 18:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014
2026-03-29 18:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014
2026-03-29 18:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69e8735f-10e7-50ca-afdd-1830a5164945 with identifier: WJ96014 to the API
2026-03-29 18:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 298,
'expiration_date': '2026-03-30T15:52:14Z',
'fuel_type': 'petrol',
'id': '69e8735f-10e7-50ca-afdd-1830a5164945',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ96014',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XJ',
'odometer': 235776,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-09-30',
'seller_name': None,
'title': 'Jaguar XJ 4.2 V8 XJ8',
'transmission': 'automatic',
'trim': '8',
'year': 2004}
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ96014%27 HTTP/1.1" 200 None
2026-03-29 18:50:12 [auto1.de] INFO: Saving data for WJ96014: {'auction_closing_time': 1774885934.0, 'created_time': 1774723612.801056, 'last_price_update_time': 1774810212.138557}
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ96014') HTTP/1.1" 204 0
2026-03-29 18:50:12 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30616%27 HTTP/1.1" 200 None
2026-03-29 18:50:12 [auto1.de] INFO: Scrape type for UW30616: 2
2026-03-29 18:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616
2026-03-29 18:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8918ef92-fdc9-502b-a6bc-bd5891d02749 with scrape type 2
2026-03-29 18:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8918ef92-fdc9-502b-a6bc-bd5891d02749 with scrape type 2
2026-03-29 18:50:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8918ef92-fdc9-502b-a6bc-bd5891d02749, identifier: UW30616
2026-03-29 18:50:12 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-29 18:50:12 [auto1.de] INFO: Scrape type for TH73061: 2
2026-03-29 18:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061
2026-03-29 18:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with scrape type 2
2026-03-29 18:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with scrape type 2
2026-03-29 18:50:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e, identifier: TH73061
2026-03-29 18:50:12 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-29 18:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616
2026-03-29 18:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616
2026-03-29 18:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8918ef92-fdc9-502b-a6bc-bd5891d02749 with identifier: UW30616 to the API
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 121,
'expiration_date': '2026-03-30T15:14:47Z',
'fuel_type': 'petrol',
'id': '8918ef92-fdc9-502b-a6bc-bd5891d02749',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW30616',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 51995,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-26',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
'transmission': 'manual',
'trim': 'Sports-Line',
'year': 2019}
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30616%27 HTTP/1.1" 200 None
2026-03-29 18:50:12 [auto1.de] INFO: Saving data for UW30616: {'auction_closing_time': 1774883687.0, 'created_time': 1774035517.045109, 'last_price_update_time': 1774810212.65839}
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW30616') HTTP/1.1" 204 0
2026-03-29 18:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061
2026-03-29 18:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061
2026-03-29 18:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec9407b9-28aa-5667-b9c2-d15ba7e6e75e with identifier: TH73061 to the API
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:07:49Z',
'fuel_type': 'diesel',
'id': 'ec9407b9-28aa-5667-b9c2-d15ba7e6e75e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH73061',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 164844,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-03',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-29 18:50:13 [auto1.de] INFO: Saving data for TH73061: {'auction_closing_time': 1774883269.0, 'created_time': 1773380693.590947, 'last_price_update_time': 1774810213.069727}
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH73061') HTTP/1.1" 204 0
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT08508%27 HTTP/1.1" 200 None
2026-03-29 18:50:13 [auto1.de] INFO: Scrape type for RT08508: 2
2026-03-29 18:50:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508
2026-03-29 18:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66889d0-9937-5e3e-8356-471cfa4e9016 with scrape type 2
2026-03-29 18:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d66889d0-9937-5e3e-8356-471cfa4e9016 with scrape type 2
2026-03-29 18:50:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d66889d0-9937-5e3e-8356-471cfa4e9016, identifier: RT08508
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-29 18:50:13 [auto1.de] INFO: Scrape type for YK83419: 2
2026-03-29 18:50:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419
2026-03-29 18:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with scrape type 2
2026-03-29 18:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with scrape type 2
2026-03-29 18:50:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730, identifier: YK83419
2026-03-29 18:50:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508
2026-03-29 18:50:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508
2026-03-29 18:50:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d66889d0-9937-5e3e-8356-471cfa4e9016 with identifier: RT08508 to the API
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:17:19Z',
'fuel_type': 'diesel',
'id': 'd66889d0-9937-5e3e-8356-471cfa4e9016',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT08508',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 133773,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-28',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBlue TDCi ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2018}
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT08508%27 HTTP/1.1" 200 None
2026-03-29 18:50:13 [auto1.de] INFO: Saving data for RT08508: {'auction_closing_time': 1774883839.0, 'created_time': 1774723573.601927, 'last_price_update_time': 1774810213.6533}
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT08508') HTTP/1.1" 204 0
2026-03-29 18:50:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419
2026-03-29 18:50:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419
2026-03-29 18:50:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fe2dca0-7a37-5b3b-9dd7-e96f6af63730 with identifier: YK83419 to the API
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:07:51Z',
'fuel_type': 'diesel',
'id': '9fe2dca0-7a37-5b3b-9dd7-e96f6af63730',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK83419',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 88515,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-01',
'seller_name': None,
'title': 'Audi Q3 2.0 TDI',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-29 18:50:13 [auto1.de] INFO: Saving data for YK83419: {'auction_closing_time': 1774883271.0, 'created_time': 1774723564.877096, 'last_price_update_time': 1774810213.939314}
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK83419') HTTP/1.1" 204 0
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-29 18:50:13 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97693%27 HTTP/1.1" 200 None
2026-03-29 18:50:13 [auto1.de] INFO: Scrape type for MY97693: 2
2026-03-29 18:50:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693
2026-03-29 18:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8af4f20-92eb-53f6-834a-887f17c7cdc6 with scrape type 2
2026-03-29 18:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8af4f20-92eb-53f6-834a-887f17c7cdc6 with scrape type 2
2026-03-29 18:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8af4f20-92eb-53f6-834a-887f17c7cdc6, identifier: MY97693
2026-03-29 18:50:14 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-29 18:50:14 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-29 18:50:14 [auto1.de] INFO: Scrape type for PS10948: 2
2026-03-29 18:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948
2026-03-29 18:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with scrape type 2
2026-03-29 18:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with scrape type 2
2026-03-29 18:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d, identifier: PS10948
2026-03-29 18:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693
2026-03-29 18:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693
2026-03-29 18:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8af4f20-92eb-53f6-834a-887f17c7cdc6 with identifier: MY97693 to the API
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:40:48Z',
'fuel_type': 'petrol',
'id': 'f8af4f20-92eb-53f6-834a-887f17c7cdc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY97693',
'listing': 'auction',
'make': 'Mitsubishi',
'model': 'Eclipse Cross',
'odometer': 153806,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-22',
'seller_name': None,
'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Intro Edition 2WD',
'transmission': 'automatic',
'trim': 'Intro Edition 2WD',
'year': 2018}
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97693%27 HTTP/1.1" 200 None
2026-03-29 18:50:14 [auto1.de] INFO: Saving data for MY97693: {'auction_closing_time': 1774885248.0, 'created_time': 1774118741.763671, 'last_price_update_time': 1774810214.513076}
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY97693') HTTP/1.1" 204 0
2026-03-29 18:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948
2026-03-29 18:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948
2026-03-29 18:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d with identifier: PS10948 to the API
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 165,
'expiration_date': '2026-03-30T15:10:10Z',
'fuel_type': 'petrol',
'id': '02e6b8b4-9aa6-5f84-b2d1-cd286d60f47d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS10948',
'listing': 'auction',
'make': 'Abarth',
'model': '595',
'odometer': 85921,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-03',
'seller_name': None,
'title': 'Abarth 595 1.4 Turbo Turismo',
'transmission': 'manual',
'trim': 'Turismo',
'year': 2019}
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-29 18:50:14 [auto1.de] INFO: Saving data for PS10948: {'auction_closing_time': 1774883410.0, 'created_time': 1774553227.767187, 'last_price_update_time': 1774810214.795877}
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS10948') HTTP/1.1" 204 0
2026-03-29 18:50:14 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH99628%27 HTTP/1.1" 200 None
2026-03-29 18:50:14 [auto1.de] INFO: Scrape type for VH99628: 2
2026-03-29 18:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628
2026-03-29 18:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5616018b-c486-5e20-816b-33a80e3313dc with scrape type 2
2026-03-29 18:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5616018b-c486-5e20-816b-33a80e3313dc with scrape type 2
2026-03-29 18:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5616018b-c486-5e20-816b-33a80e3313dc, identifier: VH99628
2026-03-29 18:50:14 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF23324%27 HTTP/1.1" 200 None
2026-03-29 18:50:14 [auto1.de] INFO: Scrape type for HF23324: 2
2026-03-29 18:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324
2026-03-29 18:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb08df1-1912-5353-a474-512edb6639c3 with scrape type 2
2026-03-29 18:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb08df1-1912-5353-a474-512edb6639c3 with scrape type 2
2026-03-29 18:50:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acb08df1-1912-5353-a474-512edb6639c3, identifier: HF23324
2026-03-29 18:50:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628
2026-03-29 18:50:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628
2026-03-29 18:50:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5616018b-c486-5e20-816b-33a80e3313dc with identifier: VH99628 to the API
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:30:13Z',
'fuel_type': 'petrol',
'id': '5616018b-c486-5e20-816b-33a80e3313dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH99628',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 154229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-10-10',
'seller_name': None,
'title': 'Toyota Aygo 1.0 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH99628%27 HTTP/1.1" 200 None
2026-03-29 18:50:15 [auto1.de] INFO: Saving data for VH99628: {'auction_closing_time': 1774884613.0, 'created_time': 1774002008.320632, 'last_price_update_time': 1774810215.327997}
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH99628') HTTP/1.1" 204 0
2026-03-29 18:50:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324
2026-03-29 18:50:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324
2026-03-29 18:50:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acb08df1-1912-5353-a474-512edb6639c3 with identifier: HF23324 to the API
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:03:31Z',
'fuel_type': 'diesel',
'id': 'acb08df1-1912-5353-a474-512edb6639c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF23324',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 155669,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-21',
'seller_name': None,
'title': 'BMW X1 xDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF23324%27 HTTP/1.1" 200 None
2026-03-29 18:50:15 [auto1.de] INFO: Saving data for HF23324: {'auction_closing_time': 1774883011.0, 'created_time': 1774723622.551707, 'last_price_update_time': 1774810215.733755}
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF23324') HTTP/1.1" 204 0
2026-03-29 18:50:15 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-29 18:50:15 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-29 18:50:15 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD58306%27 HTTP/1.1" 200 None
2026-03-29 18:50:15 [auto1.de] INFO: Scrape type for HD58306: 2
2026-03-29 18:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306
2026-03-29 18:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34849c93-8de4-58cc-b981-ea09fe9827ab with scrape type 2
2026-03-29 18:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34849c93-8de4-58cc-b981-ea09fe9827ab with scrape type 2
2026-03-29 18:50:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34849c93-8de4-58cc-b981-ea09fe9827ab, identifier: HD58306
2026-03-29 18:50:15 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-29 18:50:15 [auto1.de] INFO: Scrape type for XA19312: 2
2026-03-29 18:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-29 18:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with scrape type 2
2026-03-29 18:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with scrape type 2
2026-03-29 18:50:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5, identifier: XA19312
2026-03-29 18:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306
2026-03-29 18:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306
2026-03-29 18:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34849c93-8de4-58cc-b981-ea09fe9827ab with identifier: HD58306 to the API
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:52:58Z',
'fuel_type': 'petrol',
'id': '34849c93-8de4-58cc-b981-ea09fe9827ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD58306',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 127420,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-25',
'seller_name': None,
'title': 'Ford Kuga 1.5 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2018}
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD58306%27 HTTP/1.1" 200 None
2026-03-29 18:50:16 [auto1.de] INFO: Saving data for HD58306: {'auction_closing_time': 1774885978.0, 'created_time': 1773399368.953574, 'last_price_update_time': 1774810216.299395}
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD58306') HTTP/1.1" 204 0
2026-03-29 18:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-29 18:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312
2026-03-29 18:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5 with identifier: XA19312 to the API
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:07:54Z',
'fuel_type': 'petrol',
'id': '2f2c3ce6-e585-5ffd-883a-42e6fc5c4af5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA19312',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 89333,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-25',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 300 T AMG Line',
'transmission': 'automatic',
'trim': 'T AMG Line',
'year': 2018}
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-29 18:50:16 [auto1.de] INFO: Saving data for XA19312: {'auction_closing_time': 1774883274.0, 'created_time': 1774521577.153559, 'last_price_update_time': 1774810216.594875}
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA19312') HTTP/1.1" 204 0
2026-03-29 18:50:16 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-29 18:50:16 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE46966%27 HTTP/1.1" 200 None
2026-03-29 18:50:16 [auto1.de] INFO: Scrape type for BE46966: 2
2026-03-29 18:50:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-03-29 18:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 with scrape type 2
2026-03-29 18:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6c393d5-69d3-5a3f-92a0-ca03f32db445 with scrape type 2
2026-03-29 18:50:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6c393d5-69d3-5a3f-92a0-ca03f32db445, identifier: BE46966
2026-03-29 18:50:16 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-29 18:50:16 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-29 18:50:16 [auto1.de] INFO: Scrape type for GP53136: 2
2026-03-29 18:50:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136
2026-03-29 18:50:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with scrape type 2
2026-03-29 18:50:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with scrape type 2
2026-03-29 18:50:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06cbf1e7-271c-59ea-b058-3b805f92c2d4, identifier: GP53136
2026-03-29 18:50:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-03-29 18:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966
2026-03-29 18:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6c393d5-69d3-5a3f-92a0-ca03f32db445 with identifier: BE46966 to the API
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 313,
'expiration_date': '2026-03-30T15:19:42Z',
'fuel_type': 'diesel',
'id': 'a6c393d5-69d3-5a3f-92a0-ca03f32db445',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE46966',
'listing': 'auction',
'make': 'BMW',
'model': '7er',
'odometer': 234064,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-10',
'seller_name': None,
'title': 'BMW 7er 740d xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2014}
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE46966%27 HTTP/1.1" 200 None
2026-03-29 18:50:17 [auto1.de] INFO: Saving data for BE46966: {'auction_closing_time': 1774883982.0, 'created_time': 1774723591.01442, 'last_price_update_time': 1774810217.098723}
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE46966') HTTP/1.1" 204 0
2026-03-29 18:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136
2026-03-29 18:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136
2026-03-29 18:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06cbf1e7-271c-59ea-b058-3b805f92c2d4 with identifier: GP53136 to the API
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 305,
'expiration_date': '2026-03-30T15:25:23Z',
'fuel_type': 'diesel',
'id': '06cbf1e7-271c-59ea-b058-3b805f92c2d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP53136',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 132164,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-23',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 SD V6 Autobiography Dynamic',
'transmission': 'automatic',
'trim': 'Autobiography Dynamic',
'year': 2019}
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-29 18:50:17 [auto1.de] INFO: Saving data for GP53136: {'auction_closing_time': 1774884323.0, 'created_time': 1774552812.345501, 'last_price_update_time': 1774810217.389926}
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP53136') HTTP/1.1" 204 0
2026-03-29 18:50:17 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ46464%27 HTTP/1.1" 200 None
2026-03-29 18:50:17 [auto1.de] INFO: Scrape type for ZZ46464: 2
2026-03-29 18:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464
2026-03-29 18:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c965aa-0eac-5b01-8693-e95e067c4fc0 with scrape type 2
2026-03-29 18:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55c965aa-0eac-5b01-8693-e95e067c4fc0 with scrape type 2
2026-03-29 18:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55c965aa-0eac-5b01-8693-e95e067c4fc0, identifier: ZZ46464
2026-03-29 18:50:17 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-29 18:50:17 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-29 18:50:17 [auto1.de] INFO: Scrape type for XL14326: 2
2026-03-29 18:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326
2026-03-29 18:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9985bff2-c58c-50fc-9d36-e01348f844a9 with scrape type 2
2026-03-29 18:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9985bff2-c58c-50fc-9d36-e01348f844a9 with scrape type 2
2026-03-29 18:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9985bff2-c58c-50fc-9d36-e01348f844a9, identifier: XL14326
2026-03-29 18:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464
2026-03-29 18:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464
2026-03-29 18:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55c965aa-0eac-5b01-8693-e95e067c4fc0 with identifier: ZZ46464 to the API
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 239,
'expiration_date': '2026-03-30T15:16:59Z',
'fuel_type': 'diesel',
'id': '55c965aa-0eac-5b01-8693-e95e067c4fc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ46464',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse Marco Polo',
'odometer': 177565,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-11',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse Marco Polo V 300 d EDITION',
'transmission': 'automatic',
'trim': 'EDITION',
'year': 2020}
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ46464%27 HTTP/1.1" 200 None
2026-03-29 18:50:17 [auto1.de] INFO: Saving data for ZZ46464: {'auction_closing_time': 1774883819.0, 'created_time': 1774723588.938218, 'last_price_update_time': 1774810217.924941}
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ46464') HTTP/1.1" 204 0
2026-03-29 18:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326
2026-03-29 18:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326
2026-03-29 18:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9985bff2-c58c-50fc-9d36-e01348f844a9 with identifier: XL14326 to the API
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 192,
'expiration_date': '2026-03-30T15:31:51Z',
'fuel_type': 'petrol',
'id': '9985bff2-c58c-50fc-9d36-e01348f844a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL14326',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 55937,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-28',
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-29 18:50:18 [auto1.de] INFO: Saving data for XL14326: {'auction_closing_time': 1774884711.0, 'created_time': 1774553250.015074, 'last_price_update_time': 1774810218.305215}
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL14326') HTTP/1.1" 204 0
2026-03-29 18:50:18 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-29 18:50:18 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-29 18:50:18 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-29 18:50:18 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-29 18:50:18 [auto1.de] INFO: Scrape type for KN87388: 2
2026-03-29 18:50:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388
2026-03-29 18:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a99b3d-b564-5f90-9910-4aeadf2f1978 with scrape type 2
2026-03-29 18:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a99b3d-b564-5f90-9910-4aeadf2f1978 with scrape type 2
2026-03-29 18:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a99b3d-b564-5f90-9910-4aeadf2f1978, identifier: KN87388
2026-03-29 18:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388
2026-03-29 18:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388
2026-03-29 18:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a99b3d-b564-5f90-9910-4aeadf2f1978 with identifier: KN87388 to the API
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 279,
'expiration_date': '2026-03-30T15:10:57Z',
'fuel_type': 'petrol',
'id': 'b7a99b3d-b564-5f90-9910-4aeadf2f1978',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN87388',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 37240,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-15',
'seller_name': None,
'title': 'Renault Megane 1.8 TCe R.S.',
'transmission': 'automatic',
'trim': 'R.S.',
'year': 2020}
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-29 18:50:18 [auto1.de] INFO: Saving data for KN87388: {'auction_closing_time': 1774883457.0, 'created_time': 1774553010.64153, 'last_price_update_time': 1774810218.689087}
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN87388') HTTP/1.1" 204 0
2026-03-29 18:50:18 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:18 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB20164%27 HTTP/1.1" 200 None
2026-03-29 18:50:18 [auto1.de] INFO: Scrape type for MB20164: 2
2026-03-29 18:50:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164
2026-03-29 18:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97b1c8e3-47bd-5bea-9de4-5dd068407403 with scrape type 2
2026-03-29 18:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97b1c8e3-47bd-5bea-9de4-5dd068407403 with scrape type 2
2026-03-29 18:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97b1c8e3-47bd-5bea-9de4-5dd068407403, identifier: MB20164
2026-03-29 18:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164
2026-03-29 18:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164
2026-03-29 18:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97b1c8e3-47bd-5bea-9de4-5dd068407403 with identifier: MB20164 to the API
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 175,
'expiration_date': '2026-03-30T15:12:07Z',
'fuel_type': 'petrol',
'id': '97b1c8e3-47bd-5bea-9de4-5dd068407403',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB20164',
'listing': 'auction',
'make': 'Subaru',
'model': 'Outback',
'odometer': 159213,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-10',
'seller_name': None,
'title': 'Subaru Outback 2.5 Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB20164%27 HTTP/1.1" 200 None
2026-03-29 18:50:19 [auto1.de] INFO: Saving data for MB20164: {'auction_closing_time': 1774883527.0, 'created_time': 1774723651.457982, 'last_price_update_time': 1774810219.085301}
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB20164') HTTP/1.1" 204 0
2026-03-29 18:50:19 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-29 18:50:19 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-29 18:50:19 [auto1.de] INFO: Scrape type for UP78086: 2
2026-03-29 18:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086
2026-03-29 18:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e94baef6-b842-55e6-923c-72dfd63cd195 with scrape type 2
2026-03-29 18:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e94baef6-b842-55e6-923c-72dfd63cd195 with scrape type 2
2026-03-29 18:50:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e94baef6-b842-55e6-923c-72dfd63cd195, identifier: UP78086
2026-03-29 18:50:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:19 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL64703%27 HTTP/1.1" 200 None
2026-03-29 18:50:19 [auto1.de] INFO: Scrape type for HL64703: 2
2026-03-29 18:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703
2026-03-29 18:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b54d80ea-71b5-5cdd-a266-b510de27fe9f with scrape type 2
2026-03-29 18:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b54d80ea-71b5-5cdd-a266-b510de27fe9f with scrape type 2
2026-03-29 18:50:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b54d80ea-71b5-5cdd-a266-b510de27fe9f, identifier: HL64703
2026-03-29 18:50:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086
2026-03-29 18:50:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086
2026-03-29 18:50:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e94baef6-b842-55e6-923c-72dfd63cd195 with identifier: UP78086 to the API
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:42:30Z',
'fuel_type': 'petrol',
'id': 'e94baef6-b842-55e6-923c-72dfd63cd195',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP78086',
'listing': 'auction',
'make': 'Seat',
'model': 'Leon',
'odometer': 94250,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-31',
'seller_name': None,
'title': 'Seat Leon 1.2 TSI Style Ecomotive',
'transmission': 'manual',
'trim': 'Style Ecomotive',
'year': 2011}
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-29 18:50:19 [auto1.de] INFO: Saving data for UP78086: {'auction_closing_time': 1774885350.0, 'created_time': 1774723641.6601, 'last_price_update_time': 1774810219.605328}
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP78086') HTTP/1.1" 204 0
2026-03-29 18:50:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703
2026-03-29 18:50:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703
2026-03-29 18:50:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b54d80ea-71b5-5cdd-a266-b510de27fe9f with identifier: HL64703 to the API
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:50:16Z',
'fuel_type': 'petrol',
'id': 'b54d80ea-71b5-5cdd-a266-b510de27fe9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL64703',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 90289,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-11',
'seller_name': None,
'title': 'Skoda Kodiaq 1.5 TSI ACT Soleil',
'transmission': 'automatic',
'trim': 'Soleil',
'year': 2019}
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL64703%27 HTTP/1.1" 200 None
2026-03-29 18:50:19 [auto1.de] INFO: Saving data for HL64703: {'auction_closing_time': 1774885816.0, 'created_time': 1774723699.259565, 'last_price_update_time': 1774810219.889949}
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL64703') HTTP/1.1" 204 0
2026-03-29 18:50:19 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-29 18:50:19 [auto1.de] INFO: Scrape type for WP34859: 2
2026-03-29 18:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859
2026-03-29 18:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with scrape type 2
2026-03-29 18:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with scrape type 2
2026-03-29 18:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6, identifier: WP34859
2026-03-29 18:50:20 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30232%27 HTTP/1.1" 200 None
2026-03-29 18:50:20 [auto1.de] INFO: Scrape type for YW30232: 2
2026-03-29 18:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232
2026-03-29 18:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with scrape type 2
2026-03-29 18:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with scrape type 2
2026-03-29 18:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5, identifier: YW30232
2026-03-29 18:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859
2026-03-29 18:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859
2026-03-29 18:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6 with identifier: WP34859 to the API
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:16:38Z',
'fuel_type': 'petrol',
'id': '2c7ec5fa-3781-5cc9-aae7-88f2a6a205e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP34859',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 131525,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-26',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2014}
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-29 18:50:20 [auto1.de] INFO: Saving data for WP34859: {'auction_closing_time': 1774883798.0, 'created_time': 1774723627.372419, 'last_price_update_time': 1774810220.410377}
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP34859') HTTP/1.1" 204 0
2026-03-29 18:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232
2026-03-29 18:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232
2026-03-29 18:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64c2f32e-1ae4-5122-9ec0-9e949c7035b5 with identifier: YW30232 to the API
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:10:26Z',
'fuel_type': 'diesel',
'id': '64c2f32e-1ae4-5122-9ec0-9e949c7035b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW30232',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 254359,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-06',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Maxi Comfortline',
'transmission': 'automatic',
'trim': 'Maxi Comfortline',
'year': 2013}
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30232%27 HTTP/1.1" 200 None
2026-03-29 18:50:20 [auto1.de] INFO: Saving data for YW30232: {'auction_closing_time': 1774883426.0, 'created_time': 1774089589.641103, 'last_price_update_time': 1774810220.717028}
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW30232') HTTP/1.1" 204 0
2026-03-29 18:50:20 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-29 18:50:20 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS00894%27 HTTP/1.1" 200 None
2026-03-29 18:50:20 [auto1.de] INFO: Scrape type for JS00894: 2
2026-03-29 18:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894
2026-03-29 18:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9ab4fc4-4c34-5084-87f2-38a39718a000 with scrape type 2
2026-03-29 18:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9ab4fc4-4c34-5084-87f2-38a39718a000 with scrape type 2
2026-03-29 18:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9ab4fc4-4c34-5084-87f2-38a39718a000, identifier: JS00894
2026-03-29 18:50:20 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-29 18:50:20 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-29 18:50:20 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF87037%27 HTTP/1.1" 200 None
2026-03-29 18:50:20 [auto1.de] INFO: Scrape type for HF87037: 2
2026-03-29 18:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037
2026-03-29 18:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with scrape type 2
2026-03-29 18:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with scrape type 2
2026-03-29 18:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d, identifier: HF87037
2026-03-29 18:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894
2026-03-29 18:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894
2026-03-29 18:50:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9ab4fc4-4c34-5084-87f2-38a39718a000 with identifier: JS00894 to the API
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:32:43Z',
'fuel_type': 'petrol',
'id': 'b9ab4fc4-4c34-5084-87f2-38a39718a000',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS00894',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 139174,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-29',
'seller_name': None,
'title': 'Volkswagen Scirocco 1.4 TSI',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS00894%27 HTTP/1.1" 200 None
2026-03-29 18:50:21 [auto1.de] INFO: Saving data for JS00894: {'auction_closing_time': 1774884763.0, 'created_time': 1774723698.720092, 'last_price_update_time': 1774810221.285474}
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS00894') HTTP/1.1" 204 0
2026-03-29 18:50:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037
2026-03-29 18:50:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037
2026-03-29 18:50:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d with identifier: HF87037 to the API
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:45:58Z',
'fuel_type': 'petrol',
'id': '30b9be6a-352f-5b2f-b6f4-1f60aa0b4f9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF87037',
'listing': 'auction',
'make': 'Opel',
'model': 'Zafira Tourer',
'odometer': 148700,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-02-02',
'seller_name': None,
'title': 'Opel Zafira Tourer 1.4 Turbo Selective',
'transmission': 'manual',
'trim': 'Selective',
'year': 2016}
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF87037%27 HTTP/1.1" 200 None
2026-03-29 18:50:21 [auto1.de] INFO: Saving data for HF87037: {'auction_closing_time': 1774885558.0, 'created_time': 1774350345.935275, 'last_price_update_time': 1774810221.661728}
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF87037') HTTP/1.1" 204 0
2026-03-29 18:50:21 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-29 18:50:21 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE41699%27 HTTP/1.1" 200 None
2026-03-29 18:50:21 [auto1.de] INFO: Scrape type for KE41699: 2
2026-03-29 18:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699
2026-03-29 18:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with scrape type 2
2026-03-29 18:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with scrape type 2
2026-03-29 18:50:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f, identifier: KE41699
2026-03-29 18:50:21 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-29 18:50:21 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ99340%27 HTTP/1.1" 200 None
2026-03-29 18:50:21 [auto1.de] INFO: Scrape type for GZ99340: 2
2026-03-29 18:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340
2026-03-29 18:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109b3c28-e239-5f37-a909-b2f358343f59 with scrape type 2
2026-03-29 18:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 109b3c28-e239-5f37-a909-b2f358343f59 with scrape type 2
2026-03-29 18:50:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 109b3c28-e239-5f37-a909-b2f358343f59, identifier: GZ99340
2026-03-29 18:50:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699
2026-03-29 18:50:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699
2026-03-29 18:50:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b9cda7c-81b7-54fb-bafb-c8efb2ff038f with identifier: KE41699 to the API
2026-03-29 18:50:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:33:23Z',
'fuel_type': 'diesel',
'id': '1b9cda7c-81b7-54fb-bafb-c8efb2ff038f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE41699',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 145600,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-30',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
'transmission': 'automatic',
'trim': 'T BlueTEC',
'year': 2015}
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE41699%27 HTTP/1.1" 200 None
2026-03-29 18:50:22 [auto1.de] INFO: Saving data for KE41699: {'auction_closing_time': 1774884803.0, 'created_time': 1774723667.075393, 'last_price_update_time': 1774810222.166667}
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE41699') HTTP/1.1" 204 0
2026-03-29 18:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340
2026-03-29 18:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340
2026-03-29 18:50:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 109b3c28-e239-5f37-a909-b2f358343f59 with identifier: GZ99340 to the API
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:26:04Z',
'fuel_type': 'petrol',
'id': '109b3c28-e239-5f37-a909-b2f358343f59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ99340',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 193964,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-18',
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ99340%27 HTTP/1.1" 200 None
2026-03-29 18:50:22 [auto1.de] INFO: Saving data for GZ99340: {'auction_closing_time': 1774884364.0, 'created_time': 1774723636.504507, 'last_price_update_time': 1774810222.433177}
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ99340') HTTP/1.1" 204 0
2026-03-29 18:50:22 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH78013%27 HTTP/1.1" 200 None
2026-03-29 18:50:22 [auto1.de] INFO: Scrape type for WH78013: 2
2026-03-29 18:50:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013
2026-03-29 18:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b875ff-616a-5654-adba-cf64d8c0c77a with scrape type 2
2026-03-29 18:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43b875ff-616a-5654-adba-cf64d8c0c77a with scrape type 2
2026-03-29 18:50:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43b875ff-616a-5654-adba-cf64d8c0c77a, identifier: WH78013
2026-03-29 18:50:22 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-29 18:50:22 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB16153%27 HTTP/1.1" 200 None
2026-03-29 18:50:22 [auto1.de] INFO: Scrape type for FB16153: 2
2026-03-29 18:50:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153
2026-03-29 18:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with scrape type 2
2026-03-29 18:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with scrape type 2
2026-03-29 18:50:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc, identifier: FB16153
2026-03-29 18:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013
2026-03-29 18:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013
2026-03-29 18:50:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43b875ff-616a-5654-adba-cf64d8c0c77a with identifier: WH78013 to the API
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:14:47Z',
'fuel_type': 'petrol',
'id': '43b875ff-616a-5654-adba-cf64d8c0c77a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH78013',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 99620,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-20',
'seller_name': None,
'title': 'Audi A4 35 TFSI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH78013%27 HTTP/1.1" 200 None
2026-03-29 18:50:22 [auto1.de] INFO: Saving data for WH78013: {'auction_closing_time': 1774883687.0, 'created_time': 1774723691.598334, 'last_price_update_time': 1774810222.94691}
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH78013') HTTP/1.1" 204 0
2026-03-29 18:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153
2026-03-29 18:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153
2026-03-29 18:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be15c46f-f9a8-5a0b-a8a5-22412a33c0fc with identifier: FB16153 to the API
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:14:00Z',
'fuel_type': 'petrol',
'id': 'be15c46f-f9a8-5a0b-a8a5-22412a33c0fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB16153',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 151724,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-03',
'seller_name': None,
'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
'transmission': 'automatic',
'trim': 'sport',
'year': 2017}
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB16153%27 HTTP/1.1" 200 None
2026-03-29 18:50:23 [auto1.de] INFO: Saving data for FB16153: {'auction_closing_time': 1774883640.0, 'created_time': 1774723623.338452, 'last_price_update_time': 1774810223.24015}
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB16153') HTTP/1.1" 204 0
2026-03-29 18:50:23 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL25834%27 HTTP/1.1" 200 None
2026-03-29 18:50:23 [auto1.de] INFO: Scrape type for GL25834: 2
2026-03-29 18:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834
2026-03-29 18:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27828a04-1704-5252-9290-b3ef0c7a57d1 with scrape type 2
2026-03-29 18:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27828a04-1704-5252-9290-b3ef0c7a57d1 with scrape type 2
2026-03-29 18:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27828a04-1704-5252-9290-b3ef0c7a57d1, identifier: GL25834
2026-03-29 18:50:23 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX69067%27 HTTP/1.1" 200 None
2026-03-29 18:50:23 [auto1.de] INFO: Scrape type for AX69067: 2
2026-03-29 18:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067
2026-03-29 18:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with scrape type 2
2026-03-29 18:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with scrape type 2
2026-03-29 18:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba, identifier: AX69067
2026-03-29 18:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834
2026-03-29 18:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834
2026-03-29 18:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27828a04-1704-5252-9290-b3ef0c7a57d1 with identifier: GL25834 to the API
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:34:21Z',
'fuel_type': 'diesel',
'id': '27828a04-1704-5252-9290-b3ef0c7a57d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL25834',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 124707,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-23',
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Energy Start',
'transmission': 'manual',
'trim': 'Start',
'year': 2017}
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL25834%27 HTTP/1.1" 200 None
2026-03-29 18:50:23 [auto1.de] INFO: Saving data for GL25834: {'auction_closing_time': 1774884861.0, 'created_time': 1774723655.520184, 'last_price_update_time': 1774810223.749561}
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL25834') HTTP/1.1" 204 0
2026-03-29 18:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067
2026-03-29 18:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067
2026-03-29 18:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f90b2daf-04e2-5a3e-8bfe-93c0706d7dba with identifier: AX69067 to the API
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:35:25Z',
'fuel_type': 'petrol',
'id': 'f90b2daf-04e2-5a3e-8bfe-93c0706d7dba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX69067',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 171659,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-25',
'seller_name': None,
'title': 'Ford Focus 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2013}
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX69067%27 HTTP/1.1" 200 None
2026-03-29 18:50:24 [auto1.de] INFO: Saving data for AX69067: {'auction_closing_time': 1774884925.0, 'created_time': 1773382519.363729, 'last_price_update_time': 1774810224.050844}
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX69067') HTTP/1.1" 204 0
2026-03-29 18:50:24 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB16604%27 HTTP/1.1" 200 None
2026-03-29 18:50:24 [auto1.de] INFO: Scrape type for AB16604: 2
2026-03-29 18:50:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604
2026-03-29 18:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a730657-91aa-5dc0-8012-7284a9fa5980 with scrape type 2
2026-03-29 18:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a730657-91aa-5dc0-8012-7284a9fa5980 with scrape type 2
2026-03-29 18:50:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a730657-91aa-5dc0-8012-7284a9fa5980, identifier: AB16604
2026-03-29 18:50:24 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM63557%27 HTTP/1.1" 200 None
2026-03-29 18:50:24 [auto1.de] INFO: Scrape type for CM63557: 2
2026-03-29 18:50:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557
2026-03-29 18:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa20307-a790-55a2-a4e6-795516271113 with scrape type 2
2026-03-29 18:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afa20307-a790-55a2-a4e6-795516271113 with scrape type 2
2026-03-29 18:50:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afa20307-a790-55a2-a4e6-795516271113, identifier: CM63557
2026-03-29 18:50:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604
2026-03-29 18:50:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604
2026-03-29 18:50:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a730657-91aa-5dc0-8012-7284a9fa5980 with identifier: AB16604 to the API
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:17:49Z',
'fuel_type': 'petrol',
'id': '7a730657-91aa-5dc0-8012-7284a9fa5980',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB16604',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 65513,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-27',
'seller_name': None,
'title': 'Renault Kangoo 1.6 Luxe',
'transmission': 'automatic',
'trim': 'Luxe',
'year': 2012}
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB16604%27 HTTP/1.1" 200 None
2026-03-29 18:50:24 [auto1.de] INFO: Saving data for AB16604: {'auction_closing_time': 1774883869.0, 'created_time': 1773399862.033253, 'last_price_update_time': 1774810224.55936}
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB16604') HTTP/1.1" 204 0
2026-03-29 18:50:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557
2026-03-29 18:50:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557
2026-03-29 18:50:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afa20307-a790-55a2-a4e6-795516271113 with identifier: CM63557 to the API
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 272,
'expiration_date': '2026-03-30T15:05:33Z',
'fuel_type': 'petrol',
'id': 'afa20307-a790-55a2-a4e6-795516271113',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM63557',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 105451,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-18',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 300 Mild-Hybrid 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM63557%27 HTTP/1.1" 200 None
2026-03-29 18:50:24 [auto1.de] INFO: Saving data for CM63557: {'auction_closing_time': 1774883133.0, 'created_time': 1774350055.344002, 'last_price_update_time': 1774810224.962086}
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM63557') HTTP/1.1" 204 0
2026-03-29 18:50:24 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-29 18:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM83477%27 HTTP/1.1" 200 None
2026-03-29 18:50:25 [auto1.de] INFO: Scrape type for PM83477: 2
2026-03-29 18:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477
2026-03-29 18:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with scrape type 2
2026-03-29 18:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with scrape type 2
2026-03-29 18:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce, identifier: PM83477
2026-03-29 18:50:25 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR62229%27 HTTP/1.1" 200 None
2026-03-29 18:50:25 [auto1.de] INFO: Scrape type for YR62229: 2
2026-03-29 18:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229
2026-03-29 18:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a22b2a9-efa7-551d-b149-cba5156e9165 with scrape type 2
2026-03-29 18:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a22b2a9-efa7-551d-b149-cba5156e9165 with scrape type 2
2026-03-29 18:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a22b2a9-efa7-551d-b149-cba5156e9165, identifier: YR62229
2026-03-29 18:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477
2026-03-29 18:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477
2026-03-29 18:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf5d962c-9d53-5e10-96f5-b4f74a6b60ce with identifier: PM83477 to the API
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:21:21Z',
'fuel_type': 'petrol',
'id': 'cf5d962c-9d53-5e10-96f5-b4f74a6b60ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM83477',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 162237,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-02-12',
'seller_name': None,
'title': 'Opel Astra 1.8 Edition',
'transmission': 'automatic',
'trim': 'Edition',
'year': 2009}
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM83477%27 HTTP/1.1" 200 None
2026-03-29 18:50:25 [auto1.de] INFO: Saving data for PM83477: {'auction_closing_time': 1774884081.0, 'created_time': 1774723657.58395, 'last_price_update_time': 1774810225.479377}
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM83477') HTTP/1.1" 204 0
2026-03-29 18:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229
2026-03-29 18:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229
2026-03-29 18:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a22b2a9-efa7-551d-b149-cba5156e9165 with identifier: YR62229 to the API
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 310,
'expiration_date': '2026-03-30T15:10:27Z',
'fuel_type': 'petrol',
'id': '8a22b2a9-efa7-551d-b149-cba5156e9165',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR62229',
'listing': 'auction',
'make': 'Audi',
'model': 'S3 Sportback',
'odometer': 97955,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-04',
'seller_name': None,
'title': 'Audi S3 Sportback 2.0 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2021}
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR62229%27 HTTP/1.1" 200 None
2026-03-29 18:50:25 [auto1.de] INFO: Saving data for YR62229: {'auction_closing_time': 1774883427.0, 'created_time': 1774723625.147496, 'last_price_update_time': 1774810225.76155}
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR62229') HTTP/1.1" 204 0
2026-03-29 18:50:25 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE10609%27 HTTP/1.1" 200 None
2026-03-29 18:50:25 [auto1.de] INFO: Scrape type for XE10609: 2
2026-03-29 18:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609
2026-03-29 18:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c95ae50-25d7-57ed-9de1-1b295f91506d with scrape type 2
2026-03-29 18:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c95ae50-25d7-57ed-9de1-1b295f91506d with scrape type 2
2026-03-29 18:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c95ae50-25d7-57ed-9de1-1b295f91506d, identifier: XE10609
2026-03-29 18:50:25 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-29 18:50:25 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR94395%27 HTTP/1.1" 200 None
2026-03-29 18:50:25 [auto1.de] INFO: Scrape type for AR94395: 2
2026-03-29 18:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395
2026-03-29 18:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78c6449-b93f-5723-804c-e569d07b8637 with scrape type 2
2026-03-29 18:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78c6449-b93f-5723-804c-e569d07b8637 with scrape type 2
2026-03-29 18:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78c6449-b93f-5723-804c-e569d07b8637, identifier: AR94395
2026-03-29 18:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609
2026-03-29 18:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609
2026-03-29 18:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c95ae50-25d7-57ed-9de1-1b295f91506d with identifier: XE10609 to the API
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:13:54Z',
'fuel_type': 'diesel',
'id': '1c95ae50-25d7-57ed-9de1-1b295f91506d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE10609',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 159012,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-17',
'seller_name': None,
'title': 'BMW 1er 120d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE10609%27 HTTP/1.1" 200 None
2026-03-29 18:50:26 [auto1.de] INFO: Saving data for XE10609: {'auction_closing_time': 1774883634.0, 'created_time': 1774118825.557976, 'last_price_update_time': 1774810226.270457}
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE10609') HTTP/1.1" 204 0
2026-03-29 18:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395
2026-03-29 18:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395
2026-03-29 18:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78c6449-b93f-5723-804c-e569d07b8637 with identifier: AR94395 to the API
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:37:07Z',
'fuel_type': 'petrol',
'id': 'e78c6449-b93f-5723-804c-e569d07b8637',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR94395',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 61273,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-25',
'seller_name': None,
'title': 'Hyundai i20 1.2 YES!',
'transmission': 'manual',
'trim': 'YES!',
'year': 2017}
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR94395%27 HTTP/1.1" 200 None
2026-03-29 18:50:26 [auto1.de] INFO: Saving data for AR94395: {'auction_closing_time': 1774885027.0, 'created_time': 1774723633.629855, 'last_price_update_time': 1774810226.571338}
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR94395') HTTP/1.1" 204 0
2026-03-29 18:50:26 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-29 18:50:26 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-29 18:50:26 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU58197%27 HTTP/1.1" 200 None
2026-03-29 18:50:26 [auto1.de] INFO: Scrape type for AU58197: 2
2026-03-29 18:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197
2026-03-29 18:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with scrape type 2
2026-03-29 18:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with scrape type 2
2026-03-29 18:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b146ce1-64f4-5f09-b063-75c40ebf65b8, identifier: AU58197
2026-03-29 18:50:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:26 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF06599%27 HTTP/1.1" 200 None
2026-03-29 18:50:26 [auto1.de] INFO: Scrape type for RF06599: 2
2026-03-29 18:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599
2026-03-29 18:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09a062e2-e388-5656-abb9-ce6b16a8a82c with scrape type 2
2026-03-29 18:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09a062e2-e388-5656-abb9-ce6b16a8a82c with scrape type 2
2026-03-29 18:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09a062e2-e388-5656-abb9-ce6b16a8a82c, identifier: RF06599
2026-03-29 18:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197
2026-03-29 18:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197
2026-03-29 18:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b146ce1-64f4-5f09-b063-75c40ebf65b8 with identifier: AU58197 to the API
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:13:48Z',
'fuel_type': 'petrol',
'id': '8b146ce1-64f4-5f09-b063-75c40ebf65b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU58197',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 168247,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-05-13',
'seller_name': None,
'title': 'Skoda Fabia 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2009}
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU58197%27 HTTP/1.1" 200 None
2026-03-29 18:50:27 [auto1.de] INFO: Saving data for AU58197: {'auction_closing_time': 1774883628.0, 'created_time': 1774723672.001264, 'last_price_update_time': 1774810227.072647}
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU58197') HTTP/1.1" 204 0
2026-03-29 18:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599
2026-03-29 18:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599
2026-03-29 18:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09a062e2-e388-5656-abb9-ce6b16a8a82c with identifier: RF06599 to the API
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-30T15:50:21Z',
'fuel_type': 'petrol',
'id': '09a062e2-e388-5656-abb9-ce6b16a8a82c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF06599',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 128087,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-14',
'seller_name': None,
'title': 'Skoda Octavia 1.8 TSI Joy',
'transmission': 'manual',
'trim': 'Joy',
'year': 2016}
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF06599%27 HTTP/1.1" 200 None
2026-03-29 18:50:27 [auto1.de] INFO: Saving data for RF06599: {'auction_closing_time': 1774885821.0, 'created_time': 1774723639.040246, 'last_price_update_time': 1774810227.378618}
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF06599') HTTP/1.1" 204 0
2026-03-29 18:50:27 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-29 18:50:27 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37424%27 HTTP/1.1" 200 None
2026-03-29 18:50:27 [auto1.de] INFO: Scrape type for ED37424: 2
2026-03-29 18:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424
2026-03-29 18:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with scrape type 2
2026-03-29 18:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with scrape type 2
2026-03-29 18:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5, identifier: ED37424
2026-03-29 18:50:27 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD51126%27 HTTP/1.1" 200 None
2026-03-29 18:50:27 [auto1.de] INFO: Scrape type for AD51126: 2
2026-03-29 18:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126
2026-03-29 18:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6aa35e4-015b-57f9-aaa8-3ab46062da82 with scrape type 2
2026-03-29 18:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6aa35e4-015b-57f9-aaa8-3ab46062da82 with scrape type 2
2026-03-29 18:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6aa35e4-015b-57f9-aaa8-3ab46062da82, identifier: AD51126
2026-03-29 18:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424
2026-03-29 18:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424
2026-03-29 18:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37abdd3c-03bd-5da0-b053-1ed6247ad2d5 with identifier: ED37424 to the API
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:24:20Z',
'fuel_type': 'diesel',
'id': '37abdd3c-03bd-5da0-b053-1ed6247ad2d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED37424',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 136489,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-23',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2015}
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37424%27 HTTP/1.1" 200 None
2026-03-29 18:50:27 [auto1.de] INFO: Saving data for ED37424: {'auction_closing_time': 1774884260.0, 'created_time': 1774033648.309546, 'last_price_update_time': 1774810227.88858}
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED37424') HTTP/1.1" 204 0
2026-03-29 18:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126
2026-03-29 18:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126
2026-03-29 18:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6aa35e4-015b-57f9-aaa8-3ab46062da82 with identifier: AD51126 to the API
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 710,
'expiration_date': '2026-03-30T15:05:31Z',
'fuel_type': 'petrol',
'id': 'e6aa35e4-015b-57f9-aaa8-3ab46062da82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD51126',
'listing': 'auction',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 116099,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-11',
'seller_name': None,
'title': 'Jeep Grand Cherokee 6.2 V8 Trailhawk',
'transmission': 'automatic',
'trim': 'Trailhawk',
'year': 2019}
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD51126%27 HTTP/1.1" 200 None
2026-03-29 18:50:28 [auto1.de] INFO: Saving data for AD51126: {'auction_closing_time': 1774883131.0, 'created_time': 1774723624.390742, 'last_price_update_time': 1774810228.273444}
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD51126') HTTP/1.1" 204 0
2026-03-29 18:50:28 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP09567%27 HTTP/1.1" 200 None
2026-03-29 18:50:28 [auto1.de] INFO: Scrape type for HP09567: 2
2026-03-29 18:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567
2026-03-29 18:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with scrape type 2
2026-03-29 18:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with scrape type 2
2026-03-29 18:50:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c, identifier: HP09567
2026-03-29 18:50:28 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-29 18:50:28 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-29 18:50:28 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-29 18:50:28 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-29 18:50:28 [auto1.de] INFO: Scrape type for LD78650: 2
2026-03-29 18:50:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650
2026-03-29 18:50:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88ce754-852f-5da3-9957-03cc9318eaf1 with scrape type 2
2026-03-29 18:50:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88ce754-852f-5da3-9957-03cc9318eaf1 with scrape type 2
2026-03-29 18:50:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88ce754-852f-5da3-9957-03cc9318eaf1, identifier: LD78650
2026-03-29 18:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567
2026-03-29 18:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567
2026-03-29 18:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31a5ae1f-e733-5676-bc99-03dbf7e9b52c with identifier: HP09567 to the API
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:09:18Z',
'fuel_type': 'diesel',
'id': '31a5ae1f-e733-5676-bc99-03dbf7e9b52c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP09567',
'listing': 'auction',
'make': 'Ford',
'model': 'Galaxy',
'odometer': 233248,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-15',
'seller_name': None,
'title': 'Ford Galaxy 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2014}
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP09567%27 HTTP/1.1" 200 None
2026-03-29 18:50:28 [auto1.de] INFO: Saving data for HP09567: {'auction_closing_time': 1774883358.0, 'created_time': 1774723674.161676, 'last_price_update_time': 1774810228.779694}
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP09567') HTTP/1.1" 204 0
2026-03-29 18:50:28 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650
2026-03-29 18:50:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650
2026-03-29 18:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88ce754-852f-5da3-9957-03cc9318eaf1 with identifier: LD78650 to the API
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:12:27Z',
'fuel_type': 'petrol',
'id': 'e88ce754-852f-5da3-9957-03cc9318eaf1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD78650',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 151346,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-04-03',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 TSI Match',
'transmission': 'automatic',
'trim': 'Match',
'year': 2013}
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-29 18:50:29 [auto1.de] INFO: Saving data for LD78650: {'auction_closing_time': 1774883547.0, 'created_time': 1774723640.893326, 'last_price_update_time': 1774810229.064118}
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD78650') HTTP/1.1" 204 0
2026-03-29 18:50:29 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-29 18:50:29 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-29 18:50:29 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV25001%27 HTTP/1.1" 200 None
2026-03-29 18:50:29 [auto1.de] INFO: Scrape type for YV25001: 2
2026-03-29 18:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001
2026-03-29 18:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with scrape type 2
2026-03-29 18:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with scrape type 2
2026-03-29 18:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8, identifier: YV25001
2026-03-29 18:50:29 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-29 18:50:29 [auto1.de] INFO: Scrape type for KB26549: 2
2026-03-29 18:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549
2026-03-29 18:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25717195-72f7-597e-b717-9518c2f31283 with scrape type 2
2026-03-29 18:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25717195-72f7-597e-b717-9518c2f31283 with scrape type 2
2026-03-29 18:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25717195-72f7-597e-b717-9518c2f31283, identifier: KB26549
2026-03-29 18:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001
2026-03-29 18:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001
2026-03-29 18:50:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8 with identifier: YV25001 to the API
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:41:39Z',
'fuel_type': 'petrol',
'id': '6a6ca72f-c5f5-5964-ad1c-bf46cf221fe8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV25001',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 101992,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-21',
'seller_name': None,
'title': 'Opel Corsa 1.0 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2008}
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV25001%27 HTTP/1.1" 200 None
2026-03-29 18:50:29 [auto1.de] INFO: Saving data for YV25001: {'auction_closing_time': 1774885299.0, 'created_time': 1774723666.264173, 'last_price_update_time': 1774810229.587554}
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV25001') HTTP/1.1" 204 0
2026-03-29 18:50:29 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-29 18:50:29 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-29 18:50:29 [auto1.de] INFO: Scrape type for YR28195: 2
2026-03-29 18:50:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195
2026-03-29 18:50:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with scrape type 2
2026-03-29 18:50:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with scrape type 2
2026-03-29 18:50:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13, identifier: YR28195
2026-03-29 18:50:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549
2026-03-29 18:50:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549
2026-03-29 18:50:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25717195-72f7-597e-b717-9518c2f31283 with identifier: KB26549 to the API
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:09:19Z',
'fuel_type': 'petrol',
'id': '25717195-72f7-597e-b717-9518c2f31283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB26549',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 129297,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-10',
'seller_name': None,
'title': 'Dacia Duster 1.6 Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2011}
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-29 18:50:29 [auto1.de] INFO: Saving data for KB26549: {'auction_closing_time': 1774883359.0, 'created_time': 1774723634.643612, 'last_price_update_time': 1774810229.986788}
2026-03-29 18:50:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB26549') HTTP/1.1" 204 0
2026-03-29 18:50:30 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF34301%27 HTTP/1.1" 200 None
2026-03-29 18:50:30 [auto1.de] INFO: Scrape type for DF34301: 2
2026-03-29 18:50:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301
2026-03-29 18:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with scrape type 2
2026-03-29 18:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with scrape type 2
2026-03-29 18:50:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f, identifier: DF34301
2026-03-29 18:50:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195
2026-03-29 18:50:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195
2026-03-29 18:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd3f45a-a74a-520e-9028-ab5cc3c18e13 with identifier: YR28195 to the API
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-30T15:51:22Z',
'fuel_type': 'petrol',
'id': '5fd3f45a-a74a-520e-9028-ab5cc3c18e13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR28195',
'listing': 'auction',
'make': 'Kia',
'model': 'Venga',
'odometer': 175229,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-30',
'seller_name': None,
'title': 'Kia Venga 1.6 Spirit',
'transmission': 'manual',
'trim': 'Spirit',
'year': 2011}
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-29 18:50:30 [auto1.de] INFO: Saving data for YR28195: {'auction_closing_time': 1774885882.0, 'created_time': 1774723700.876153, 'last_price_update_time': 1774810230.595641}
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR28195') HTTP/1.1" 204 0
2026-03-29 18:50:30 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-29 18:50:30 [auto1.de] INFO: Scrape type for VL06986: 2
2026-03-29 18:50:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986
2026-03-29 18:50:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f758484-a291-5788-ad42-3b6ac222f6e8 with scrape type 2
2026-03-29 18:50:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f758484-a291-5788-ad42-3b6ac222f6e8 with scrape type 2
2026-03-29 18:50:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f758484-a291-5788-ad42-3b6ac222f6e8, identifier: VL06986
2026-03-29 18:50:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301
2026-03-29 18:50:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301
2026-03-29 18:50:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54a983bf-4eaa-5bbe-82bb-9b27bbcc499f with identifier: DF34301 to the API
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 290,
'expiration_date': '2026-03-30T15:12:35Z',
'fuel_type': 'diesel',
'id': '54a983bf-4eaa-5bbe-82bb-9b27bbcc499f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF34301',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 83765,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-19',
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 300 d Mild-Hybrid 4Matic',
'transmission': 'automatic',
'trim': '4Matic',
'year': 2023}
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF34301%27 HTTP/1.1" 200 None
2026-03-29 18:50:31 [auto1.de] INFO: Saving data for DF34301: {'auction_closing_time': 1774883555.0, 'created_time': 1773381542.09826, 'last_price_update_time': 1774810231.000491}
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF34301') HTTP/1.1" 204 0
2026-03-29 18:50:31 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-29 18:50:31 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-29 18:50:31 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-29 18:50:31 [auto1.de] INFO: Scrape type for SR75246: 2
2026-03-29 18:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246
2026-03-29 18:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac28de86-0f2e-5214-840d-8ef262063c5b with scrape type 2
2026-03-29 18:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac28de86-0f2e-5214-840d-8ef262063c5b with scrape type 2
2026-03-29 18:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac28de86-0f2e-5214-840d-8ef262063c5b, identifier: SR75246
2026-03-29 18:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986
2026-03-29 18:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986
2026-03-29 18:50:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f758484-a291-5788-ad42-3b6ac222f6e8 with identifier: VL06986 to the API
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 220,
'expiration_date': '2026-03-30T15:16:30Z',
'fuel_type': 'petrol',
'id': '6f758484-a291-5788-ad42-3b6ac222f6e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL06986',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 135621,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-13',
'seller_name': None,
'title': 'Volkswagen Beetle 2.0 TSI Exclusive Sport BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Exclusive Sport BlueMotion Tech',
'year': 2015}
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-29 18:50:31 [auto1.de] INFO: Saving data for VL06986: {'auction_closing_time': 1774883790.0, 'created_time': 1774723638.155645, 'last_price_update_time': 1774810231.728299}
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL06986') HTTP/1.1" 204 0
2026-03-29 18:50:31 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-29 18:50:31 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-29 18:50:31 [auto1.de] INFO: Scrape type for VA98416: 2
2026-03-29 18:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416
2026-03-29 18:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8661c2eb-31db-51be-86b6-a83a7d17c61d with scrape type 2
2026-03-29 18:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8661c2eb-31db-51be-86b6-a83a7d17c61d with scrape type 2
2026-03-29 18:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8661c2eb-31db-51be-86b6-a83a7d17c61d, identifier: VA98416
2026-03-29 18:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246
2026-03-29 18:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246
2026-03-29 18:50:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac28de86-0f2e-5214-840d-8ef262063c5b with identifier: SR75246 to the API
2026-03-29 18:50:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:10:12Z',
'fuel_type': 'petrol',
'id': 'ac28de86-0f2e-5214-840d-8ef262063c5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR75246',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 182331,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-27',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CGI T AMG Line',
'transmission': 'manual',
'trim': 'T AMG Line',
'year': 2015}
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-29 18:50:32 [auto1.de] INFO: Saving data for SR75246: {'auction_closing_time': 1774883412.0, 'created_time': 1774723696.39255, 'last_price_update_time': 1774810232.151156}
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR75246') HTTP/1.1" 204 0
2026-03-29 18:50:32 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-29 18:50:32 [auto1.de] INFO: Scrape type for WB94106: 2
2026-03-29 18:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106
2026-03-29 18:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with scrape type 2
2026-03-29 18:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with scrape type 2
2026-03-29 18:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705, identifier: WB94106
2026-03-29 18:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416
2026-03-29 18:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416
2026-03-29 18:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8661c2eb-31db-51be-86b6-a83a7d17c61d with identifier: VA98416 to the API
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:30:17Z',
'fuel_type': 'petrol',
'id': '8661c2eb-31db-51be-86b6-a83a7d17c61d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA98416',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Alfa 147',
'odometer': 136621,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-05-07',
'seller_name': None,
'title': 'Alfa Romeo Alfa 147 2.0 Selespeed Distinctive',
'transmission': 'automatic',
'trim': 'Selespeed Distinctive',
'year': 2001}
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-29 18:50:32 [auto1.de] INFO: Saving data for VA98416: {'auction_closing_time': 1774884617.0, 'created_time': 1774723672.368821, 'last_price_update_time': 1774810232.548582}
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA98416') HTTP/1.1" 204 0
2026-03-29 18:50:32 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-29 18:50:32 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-29 18:50:32 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-29 18:50:32 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-29 18:50:32 [auto1.de] INFO: Scrape type for SC91438: 2
2026-03-29 18:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438
2026-03-29 18:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ac8ee3-b98b-500b-a220-115938e6565b with scrape type 2
2026-03-29 18:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4ac8ee3-b98b-500b-a220-115938e6565b with scrape type 2
2026-03-29 18:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4ac8ee3-b98b-500b-a220-115938e6565b, identifier: SC91438
2026-03-29 18:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106
2026-03-29 18:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106
2026-03-29 18:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a2e0d09-96f8-5c6d-819d-bbe8c9db6705 with identifier: WB94106 to the API
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:35:20Z',
'fuel_type': 'petrol',
'id': '4a2e0d09-96f8-5c6d-819d-bbe8c9db6705',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB94106',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 81919,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-08',
'seller_name': None,
'title': 'Ford Focus 1.6 Ti-VCT Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2011}
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-29 18:50:32 [auto1.de] INFO: Saving data for WB94106: {'auction_closing_time': 1774884920.0, 'created_time': 1774723642.660722, 'last_price_update_time': 1774810232.988164}
2026-03-29 18:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB94106') HTTP/1.1" 204 0
2026-03-29 18:50:33 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-29 18:50:33 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-29 18:50:33 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-29 18:50:33 [auto1.de] INFO: Scrape type for RS04004: 2
2026-03-29 18:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004
2026-03-29 18:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f07142c-3944-5a62-92d0-8dae174fba2d with scrape type 2
2026-03-29 18:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f07142c-3944-5a62-92d0-8dae174fba2d with scrape type 2
2026-03-29 18:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f07142c-3944-5a62-92d0-8dae174fba2d, identifier: RS04004
2026-03-29 18:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438
2026-03-29 18:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438
2026-03-29 18:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4ac8ee3-b98b-500b-a220-115938e6565b with identifier: SC91438 to the API
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:41:31Z',
'fuel_type': 'petrol',
'id': 'f4ac8ee3-b98b-500b-a220-115938e6565b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC91438',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 190414,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-03-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2005}
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-29 18:50:33 [auto1.de] INFO: Saving data for SC91438: {'auction_closing_time': 1774885291.0, 'created_time': 1774723712.680953, 'last_price_update_time': 1774810233.506858}
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC91438') HTTP/1.1" 204 0
2026-03-29 18:50:33 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-29 18:50:33 [auto1.de] INFO: Scrape type for ZP72952: 2
2026-03-29 18:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952
2026-03-29 18:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 765aa777-690b-510d-b4de-f91cc4d7e533 with scrape type 2
2026-03-29 18:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 765aa777-690b-510d-b4de-f91cc4d7e533 with scrape type 2
2026-03-29 18:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 765aa777-690b-510d-b4de-f91cc4d7e533, identifier: ZP72952
2026-03-29 18:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004
2026-03-29 18:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004
2026-03-29 18:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f07142c-3944-5a62-92d0-8dae174fba2d with identifier: RS04004 to the API
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 177,
'expiration_date': '2026-03-30T15:02:02Z',
'fuel_type': 'petrol',
'id': '8f07142c-3944-5a62-92d0-8dae174fba2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS04004',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 133500,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-11-22',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 TGDI Premium 2WD',
'transmission': 'manual',
'trim': 'Premium 2WD',
'year': 2016}
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-29 18:50:33 [auto1.de] INFO: Saving data for RS04004: {'auction_closing_time': 1774882922.0, 'created_time': 1774723676.764999, 'last_price_update_time': 1774810233.909539}
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS04004') HTTP/1.1" 204 0
2026-03-29 18:50:33 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-29 18:50:33 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-29 18:50:33 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-29 18:50:33 [auto1.de] INFO: Scrape type for RG78174: 2
2026-03-29 18:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174
2026-03-29 18:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a79f196-2fff-59c7-a2c7-258273abaa85 with scrape type 2
2026-03-29 18:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a79f196-2fff-59c7-a2c7-258273abaa85 with scrape type 2
2026-03-29 18:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a79f196-2fff-59c7-a2c7-258273abaa85, identifier: RG78174
2026-03-29 18:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952
2026-03-29 18:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952
2026-03-29 18:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 765aa777-690b-510d-b4de-f91cc4d7e533 with identifier: ZP72952 to the API
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:42:15Z',
'fuel_type': 'petrol',
'id': '765aa777-690b-510d-b4de-f91cc4d7e533',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP72952',
'listing': 'auction',
'make': 'Opel',
'model': 'Agila',
'odometer': 106356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-29',
'seller_name': None,
'title': 'Opel Agila 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-29 18:50:34 [auto1.de] INFO: Saving data for ZP72952: {'auction_closing_time': 1774885335.0, 'created_time': 1773426972.685849, 'last_price_update_time': 1774810234.325142}
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP72952') HTTP/1.1" 204 0
2026-03-29 18:50:34 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-29 18:50:34 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-29 18:50:34 [auto1.de] INFO: Scrape type for EP86808: 2
2026-03-29 18:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808
2026-03-29 18:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 924edd99-4850-51d7-a327-18cce27c82df with scrape type 2
2026-03-29 18:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 924edd99-4850-51d7-a327-18cce27c82df with scrape type 2
2026-03-29 18:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 924edd99-4850-51d7-a327-18cce27c82df, identifier: EP86808
2026-03-29 18:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174
2026-03-29 18:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174
2026-03-29 18:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a79f196-2fff-59c7-a2c7-258273abaa85 with identifier: RG78174 to the API
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:10:59Z',
'fuel_type': 'petrol',
'id': '1a79f196-2fff-59c7-a2c7-258273abaa85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG78174',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 132719,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-15',
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-29 18:50:34 [auto1.de] INFO: Saving data for RG78174: {'auction_closing_time': 1774883459.0, 'created_time': 1774723709.474921, 'last_price_update_time': 1774810234.738897}
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG78174') HTTP/1.1" 204 0
2026-03-29 18:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808
2026-03-29 18:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808
2026-03-29 18:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 924edd99-4850-51d7-a327-18cce27c82df with identifier: EP86808 to the API
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 158,
'expiration_date': '2026-03-30T15:06:39Z',
'fuel_type': 'petrol',
'id': '924edd99-4850-51d7-a327-18cce27c82df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP86808',
'listing': 'auction',
'make': 'Subaru',
'model': 'Forester',
'odometer': 83493,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-06-29',
'seller_name': None,
'title': 'Subaru Forester 2.0 X Comfort',
'transmission': 'automatic',
'trim': 'X Comfort',
'year': 2006}
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-29 18:50:35 [auto1.de] INFO: Saving data for EP86808: {'auction_closing_time': 1774883199.0, 'created_time': 1774723668.846329, 'last_price_update_time': 1774810235.025089}
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP86808') HTTP/1.1" 204 0
2026-03-29 18:50:35 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-29 18:50:35 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-29 18:50:35 [auto1.de] INFO: Scrape type for SK20247: 2
2026-03-29 18:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247
2026-03-29 18:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b13deea-6ba9-5e51-8035-415a89952eff with scrape type 2
2026-03-29 18:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b13deea-6ba9-5e51-8035-415a89952eff with scrape type 2
2026-03-29 18:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b13deea-6ba9-5e51-8035-415a89952eff, identifier: SK20247
2026-03-29 18:50:35 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-29 18:50:35 [auto1.de] INFO: Scrape type for YA04256: 2
2026-03-29 18:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256
2026-03-29 18:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ae606e-72bd-556a-8912-3c67e8fb10ed with scrape type 2
2026-03-29 18:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ae606e-72bd-556a-8912-3c67e8fb10ed with scrape type 2
2026-03-29 18:50:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ae606e-72bd-556a-8912-3c67e8fb10ed, identifier: YA04256
2026-03-29 18:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247
2026-03-29 18:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247
2026-03-29 18:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b13deea-6ba9-5e51-8035-415a89952eff with identifier: SK20247 to the API
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:33:46Z',
'fuel_type': 'diesel',
'id': '0b13deea-6ba9-5e51-8035-415a89952eff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK20247',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito Tourer',
'odometer': 55852,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-17',
'seller_name': None,
'title': 'Mercedes-Benz Vito Tourer 114 CDI Pro extralang',
'transmission': 'automatic',
'trim': 'Pro extralang',
'year': 2019}
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-29 18:50:35 [auto1.de] INFO: Saving data for SK20247: {'auction_closing_time': 1774884826.0, 'created_time': 1773427822.049423, 'last_price_update_time': 1774810235.541139}
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK20247') HTTP/1.1" 204 0
2026-03-29 18:50:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256
2026-03-29 18:50:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256
2026-03-29 18:50:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ae606e-72bd-556a-8912-3c67e8fb10ed with identifier: YA04256 to the API
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:58:55Z',
'fuel_type': 'diesel',
'id': '08ae606e-72bd-556a-8912-3c67e8fb10ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA04256',
'listing': 'auction',
'make': 'Audi',
'model': 'A6 Allroad',
'odometer': 171839,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-08',
'seller_name': None,
'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-29 18:50:35 [auto1.de] INFO: Saving data for YA04256: {'auction_closing_time': 1774886335.0, 'created_time': 1773382432.531046, 'last_price_update_time': 1774810235.912439}
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA04256') HTTP/1.1" 204 0
2026-03-29 18:50:35 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-29 18:50:35 [auto1.de] INFO: Scrape type for KY61393: 2
2026-03-29 18:50:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393
2026-03-29 18:50:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b017d1-5c92-51d4-b14b-acbbadf32f20 with scrape type 2
2026-03-29 18:50:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b017d1-5c92-51d4-b14b-acbbadf32f20 with scrape type 2
2026-03-29 18:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3b017d1-5c92-51d4-b14b-acbbadf32f20, identifier: KY61393
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-29 18:50:36 [auto1.de] INFO: Scrape type for WS15050: 2
2026-03-29 18:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050
2026-03-29 18:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb10b814-2a1b-5190-ae90-62811cbea39f with scrape type 2
2026-03-29 18:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb10b814-2a1b-5190-ae90-62811cbea39f with scrape type 2
2026-03-29 18:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb10b814-2a1b-5190-ae90-62811cbea39f, identifier: WS15050
2026-03-29 18:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393
2026-03-29 18:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393
2026-03-29 18:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3b017d1-5c92-51d4-b14b-acbbadf32f20 with identifier: KY61393 to the API
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:31:47Z',
'fuel_type': 'diesel',
'id': 'd3b017d1-5c92-51d4-b14b-acbbadf32f20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY61393',
'listing': 'auction',
'make': 'Porsche',
'model': 'Macan',
'odometer': 125871,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-18',
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-29 18:50:36 [auto1.de] INFO: Saving data for KY61393: {'auction_closing_time': 1774884707.0, 'created_time': 1774723695.353073, 'last_price_update_time': 1774810236.421304}
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY61393') HTTP/1.1" 204 0
2026-03-29 18:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050
2026-03-29 18:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050
2026-03-29 18:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb10b814-2a1b-5190-ae90-62811cbea39f with identifier: WS15050 to the API
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:16:18Z',
'fuel_type': 'petrol',
'id': 'bb10b814-2a1b-5190-ae90-62811cbea39f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS15050',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 171435,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-04',
'seller_name': None,
'title': 'BMW 5er 523i',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-29 18:50:36 [auto1.de] INFO: Saving data for WS15050: {'auction_closing_time': 1774883778.0, 'created_time': 1774723662.418964, 'last_price_update_time': 1774810236.711321}
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS15050') HTTP/1.1" 204 0
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-29 18:50:36 [auto1.de] INFO: Scrape type for HK51191: 2
2026-03-29 18:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191
2026-03-29 18:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404e397b-be34-542b-80b5-1a9b2bae2987 with scrape type 2
2026-03-29 18:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 404e397b-be34-542b-80b5-1a9b2bae2987 with scrape type 2
2026-03-29 18:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 404e397b-be34-542b-80b5-1a9b2bae2987, identifier: HK51191
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-29 18:50:36 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-29 18:50:36 [auto1.de] INFO: Scrape type for UN41694: 2
2026-03-29 18:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694
2026-03-29 18:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with scrape type 2
2026-03-29 18:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with scrape type 2
2026-03-29 18:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080, identifier: UN41694
2026-03-29 18:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191
2026-03-29 18:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191
2026-03-29 18:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 404e397b-be34-542b-80b5-1a9b2bae2987 with identifier: HK51191 to the API
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:12:24Z',
'fuel_type': 'petrol',
'id': '404e397b-be34-542b-80b5-1a9b2bae2987',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK51191',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf V',
'odometer': 121455,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-12-31',
'seller_name': None,
'title': 'Volkswagen Golf V 1.4 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2003}
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-29 18:50:37 [auto1.de] INFO: Saving data for HK51191: {'auction_closing_time': 1774883544.0, 'created_time': 1774723712.279121, 'last_price_update_time': 1774810237.216954}
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK51191') HTTP/1.1" 204 0
2026-03-29 18:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694
2026-03-29 18:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694
2026-03-29 18:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cec2c4f-3ecf-5d65-b460-e80a2b2bb080 with identifier: UN41694 to the API
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:57:56Z',
'fuel_type': 'petrol',
'id': '4cec2c4f-3ecf-5d65-b460-e80a2b2bb080',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN41694',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 290737,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-30',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Best of',
'transmission': 'manual',
'trim': 'Best of',
'year': 2012}
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-29 18:50:37 [auto1.de] INFO: Saving data for UN41694: {'auction_closing_time': 1774886276.0, 'created_time': 1774723711.896454, 'last_price_update_time': 1774810237.533933}
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN41694') HTTP/1.1" 204 0
2026-03-29 18:50:37 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-29 18:50:37 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-29 18:50:37 [auto1.de] INFO: Scrape type for NH81778: 2
2026-03-29 18:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778
2026-03-29 18:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88a464b-67d2-50eb-b326-9193ed45f227 with scrape type 2
2026-03-29 18:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88a464b-67d2-50eb-b326-9193ed45f227 with scrape type 2
2026-03-29 18:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88a464b-67d2-50eb-b326-9193ed45f227, identifier: NH81778
2026-03-29 18:50:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:37 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-29 18:50:37 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-29 18:50:37 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-29 18:50:37 [auto1.de] INFO: Scrape type for UJ06873: 2
2026-03-29 18:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873
2026-03-29 18:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with scrape type 2
2026-03-29 18:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with scrape type 2
2026-03-29 18:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c, identifier: UJ06873
2026-03-29 18:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778
2026-03-29 18:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778
2026-03-29 18:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88a464b-67d2-50eb-b326-9193ed45f227 with identifier: NH81778 to the API
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:58:49Z',
'fuel_type': 'petrol',
'id': 'e88a464b-67d2-50eb-b326-9193ed45f227',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH81778',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 48365,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seller_name': None,
'title': 'Opel Corsa 1.2 Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2017}
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-29 18:50:38 [auto1.de] INFO: Saving data for NH81778: {'auction_closing_time': 1774886329.0, 'created_time': 1774723710.167942, 'last_price_update_time': 1774810238.099406}
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH81778') HTTP/1.1" 204 0
2026-03-29 18:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873
2026-03-29 18:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873
2026-03-29 18:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c with identifier: UJ06873 to the API
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 265,
'expiration_date': '2026-03-30T15:45:36Z',
'fuel_type': 'petrol',
'id': 'f1ae91c1-d86d-5925-a5d3-8bf8f6596e8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ06873',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 146519,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-18',
'seller_name': None,
'title': 'Renault Megane 2.0 TCe Renault Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2015}
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-29 18:50:38 [auto1.de] INFO: Saving data for UJ06873: {'auction_closing_time': 1774885536.0, 'created_time': 1774723662.08247, 'last_price_update_time': 1774810238.489343}
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ06873') HTTP/1.1" 204 0
2026-03-29 18:50:38 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-29 18:50:38 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-29 18:50:38 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-29 18:50:38 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-29 18:50:38 [auto1.de] INFO: Scrape type for RZ32125: 2
2026-03-29 18:50:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125
2026-03-29 18:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e7f37c-07e4-5534-93d1-a7ba172d6ced with scrape type 2
2026-03-29 18:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e7f37c-07e4-5534-93d1-a7ba172d6ced with scrape type 2
2026-03-29 18:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4e7f37c-07e4-5534-93d1-a7ba172d6ced, identifier: RZ32125
2026-03-29 18:50:38 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-29 18:50:38 [auto1.de] INFO: Scrape type for KR32445: 2
2026-03-29 18:50:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445
2026-03-29 18:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb61f94-294e-5efc-92a7-e3a616506273 with scrape type 2
2026-03-29 18:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb61f94-294e-5efc-92a7-e3a616506273 with scrape type 2
2026-03-29 18:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfb61f94-294e-5efc-92a7-e3a616506273, identifier: KR32445
2026-03-29 18:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125
2026-03-29 18:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125
2026-03-29 18:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4e7f37c-07e4-5534-93d1-a7ba172d6ced with identifier: RZ32125 to the API
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 197,
'expiration_date': '2026-03-30T15:00:42Z',
'fuel_type': 'diesel',
'id': 'b4e7f37c-07e4-5534-93d1-a7ba172d6ced',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ32125',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 341608,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-06-04',
'seller_name': None,
'title': 'BMW 3er 325d',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-29 18:50:38 [auto1.de] INFO: Saving data for RZ32125: {'auction_closing_time': 1774882842.0, 'created_time': 1774723703.922749, 'last_price_update_time': 1774810238.968404}
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ32125') HTTP/1.1" 204 0
2026-03-29 18:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445
2026-03-29 18:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445
2026-03-29 18:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfb61f94-294e-5efc-92a7-e3a616506273 with identifier: KR32445 to the API
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 299,
'expiration_date': '2026-03-30T15:28:00Z',
'fuel_type': 'hybrid',
'id': 'dfb61f94-294e-5efc-92a7-e3a616506273',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR32445',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 97017,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-22',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid Be Chic 4x4',
'transmission': 'automatic',
'trim': 'Be Chic 4x4',
'year': 2020}
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-29 18:50:39 [auto1.de] INFO: Saving data for KR32445: {'auction_closing_time': 1774884480.0, 'created_time': 1774723665.485196, 'last_price_update_time': 1774810239.243441}
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR32445') HTTP/1.1" 204 0
2026-03-29 18:50:39 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-29 18:50:39 [auto1.de] INFO: Scrape type for LC33446: 2
2026-03-29 18:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446
2026-03-29 18:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e24f4af9-1614-5905-9855-baee67ecc2a9 with scrape type 2
2026-03-29 18:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e24f4af9-1614-5905-9855-baee67ecc2a9 with scrape type 2
2026-03-29 18:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e24f4af9-1614-5905-9855-baee67ecc2a9, identifier: LC33446
2026-03-29 18:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446
2026-03-29 18:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446
2026-03-29 18:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e24f4af9-1614-5905-9855-baee67ecc2a9 with identifier: LC33446 to the API
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:19:14Z',
'fuel_type': 'petrol',
'id': 'e24f4af9-1614-5905-9855-baee67ecc2a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC33446',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf Plus',
'odometer': 142136,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-10-24',
'seller_name': None,
'title': 'Volkswagen Golf Plus 1.4 TSI Team',
'transmission': 'automatic',
'trim': 'Team',
'year': 2010}
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-29 18:50:39 [auto1.de] INFO: Saving data for LC33446: {'auction_closing_time': 1774883954.0, 'created_time': 1774033549.751531, 'last_price_update_time': 1774810239.646947}
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC33446') HTTP/1.1" 204 0
2026-03-29 18:50:39 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:39 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-29 18:50:39 [auto1.de] INFO: Scrape type for JA37481: 2
2026-03-29 18:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481
2026-03-29 18:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569d06e1-8edf-5e5a-b569-ab45de60d82d with scrape type 2
2026-03-29 18:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 569d06e1-8edf-5e5a-b569-ab45de60d82d with scrape type 2
2026-03-29 18:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 569d06e1-8edf-5e5a-b569-ab45de60d82d, identifier: JA37481
2026-03-29 18:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481
2026-03-29 18:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481
2026-03-29 18:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 569d06e1-8edf-5e5a-b569-ab45de60d82d with identifier: JA37481 to the API
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:33:41Z',
'fuel_type': 'petrol',
'id': '569d06e1-8edf-5e5a-b569-ab45de60d82d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA37481',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 131752,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-25',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Super',
'transmission': 'manual',
'trim': 'Super',
'year': 2011}
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Saving data for JA37481: {'auction_closing_time': 1774884821.0, 'created_time': 1774035211.510155, 'last_price_update_time': 1774810240.041291}
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA37481') HTTP/1.1" 204 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for WV82579: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for ZP80469: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for CW56448: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for DL34972: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for ZD10006: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for FX32904: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for PB79978: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for SX18437: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for GF30877: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for CD84483: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for GM88868: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for AT60125: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for WA47251: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for RC64872: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for GV73009: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for SR63291: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for EP03101: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for HA64256: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for BH34221: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-29 18:50:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for ZT00661: 2
2026-03-29 18:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661
2026-03-29 18:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with scrape type 2
2026-03-29 18:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with scrape type 2
2026-03-29 18:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba, identifier: ZT00661
2026-03-29 18:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661
2026-03-29 18:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661
2026-03-29 18:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 312f9c5f-5b67-5d37-b8b5-78c56c1b07ba with identifier: ZT00661 to the API
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:24:17Z',
'fuel_type': 'petrol',
'id': '312f9c5f-5b67-5d37-b8b5-78c56c1b07ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT00661',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 119356,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-22',
'seller_name': None,
'title': 'Hyundai i30 1.4 TGDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2018}
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Saving data for ZT00661: {'auction_closing_time': 1774884257.0, 'created_time': 1774723713.062657, 'last_price_update_time': 1774810240.780143}
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT00661') HTTP/1.1" 204 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for DG46200: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for BU17582: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for HN71880: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for UT62888: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for CN24608: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-29 18:50:40 [auto1.de] INFO: Scrape type for BE39564: 0
2026-03-29 18:50:40 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-29 18:50:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:42 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for PT22331: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for BC15764: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for YW82863: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for AR37862: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for XR83794: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for DM55805: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for BR74031: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for ZG46471: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for ZR61272: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for YU16554: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for PR78588: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for RK30802: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for UB66562: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for DY16606: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for DK90225: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for MC13380: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for TD16668: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for GF54285: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-29 18:50:42 [auto1.de] INFO: Scrape type for JM74850: 0
2026-03-29 18:50:42 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-29 18:50:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:43 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for CR42013: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for CU69011: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for WD92607: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for GM28208: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for XE92374: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for EZ06190: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for RE79871: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for GJ71513: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for XT67531: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for PB33753: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for TU57767: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for HR78495: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-29 18:50:43 [auto1.de] INFO: Scrape type for RU85035: 0
2026-03-29 18:50:43 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-29 18:50:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:44 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for VJ45584: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for UB45344: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for NF65282: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for LM10522: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for VG29831: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for GX51381: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for YP50016: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for XN06908: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for SY64199: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for XV62067: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for EH91582: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for SG58819: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for FE70575: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for TK97651: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for ER21698: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for DY33691: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-29 18:50:44 [auto1.de] INFO: Scrape type for WV98635: 0
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-29 18:50:44 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-29 18:50:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:46 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for WF26983: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for PB01809: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for DA97993: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for AD84103: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for NV43592: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for PL81843: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for WW38185: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for UW13690: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for CW14038: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for HS42053: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for PY14416: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for DM10226: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for EE69038: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for PA12194: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for HZ13405: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for LU05124: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for TJ50371: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for PA26532: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-29 18:50:46 [auto1.de] INFO: Scrape type for CY89611: 0
2026-03-29 18:50:46 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-29 18:50:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:47 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for DV90621: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for AG97842: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for LA95104: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for LX44847: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for GG20866: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for WY65265: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for RV78416: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for GB67844: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for GJ08958: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for ZD45339: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for BU26829: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for UL74029: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for MF41650: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for NV71817: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for TG89658: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for GA70819: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for BW55074: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for XE90423: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for SK80695: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for DU93693: 0
2026-03-29 18:50:47 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-29 18:50:47 [auto1.de] INFO: Scrape type for XV72554: 0
2026-03-29 18:50:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:49 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-29 18:50:49 [auto1.de] INFO: Scrape type for RG68419: 0
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-29 18:50:49 [auto1.de] INFO: Scrape type for NE45887: 0
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-29 18:50:49 [auto1.de] INFO: Scrape type for VZ98908: 0
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-29 18:50:49 [auto1.de] INFO: Scrape type for BH58500: 0
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-29 18:50:49 [auto1.de] INFO: Scrape type for FN47599: 0
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-29 18:50:49 [auto1.de] INFO: Scrape type for JS16399: 0
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-29 18:50:49 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-29 18:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for JP40190: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for JN77870: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for LR31578: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for KV33816: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for MV90577: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for DF55649: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for ED71538: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for PJ47645: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for UT04321: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for DF72133: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for RL77282: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for NC99241: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for YW14341: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for WB94546: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-29 18:50:50 [auto1.de] INFO: Scrape type for LV05660: 0
2026-03-29 18:50:50 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-29 18:50:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:51 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for UJ37250: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for BF02767: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for HX00661: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for RC95289: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for GE96927: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for XL36309: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for FM75567: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for TU93300: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for SH00876: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for AG44580: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for RP91666: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for YS46144: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for BE92832: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-29 18:50:51 [auto1.de] INFO: Scrape type for TN63274: 0
2026-03-29 18:50:51 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for BJ75751: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for ZT80456: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for VY67413: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for HB69209: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for GF17035: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for ZV63958: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for VG24913: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for XE04045: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for UV81203: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for FK48222: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for KE90826: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for MN93715: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for BS68769: 0
2026-03-29 18:50:52 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-29 18:50:52 [auto1.de] INFO: Scrape type for LJ34502: 2
2026-03-29 18:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-29 18:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a355cc45-b00a-515e-9827-996bbf42d84a with scrape type 2
2026-03-29 18:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a355cc45-b00a-515e-9827-996bbf42d84a with scrape type 2
2026-03-29 18:50:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a355cc45-b00a-515e-9827-996bbf42d84a, identifier: LJ34502
2026-03-29 18:50:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-29 18:50:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502
2026-03-29 18:50:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a355cc45-b00a-515e-9827-996bbf42d84a with identifier: LJ34502 to the API
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 18:50:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 18:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:03:14Z',
'fuel_type': 'diesel',
'id': 'a355cc45-b00a-515e-9827-996bbf42d84a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ34502',
'listing': 'auction',
'make': 'Kia',
'model': 'Sorento',
'odometer': 87038,
'odometer_reading_unit': 'km',
'origin_country_code': 'DE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seller_name': None,
'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
'transmission': 'automatic',
'trim': 'Platinum Edition 4WD',
'year': 2017}
2026-03-29 18:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-29 18:50:53 [auto1.de] INFO: Saving data for LJ34502: {'auction_closing_time': 1774882994.0, 'created_time': 1774521625.805204, 'last_price_update_time': 1774810253.097584}
2026-03-29 18:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ34502') HTTP/1.1" 204 0
2026-03-29 18:50:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:54 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for TJ68834: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for NG50641: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for BA31995: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for PF87793: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for RR24690: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for XD36777: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for PC48603: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for GJ17699: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for HF47476: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for DC48276: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for DS20438: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for CC34542: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for WC61131: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for RU40839: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for BC10414: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for LG96250: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-29 18:50:54 [auto1.de] INFO: Scrape type for SB27489: 0
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-29 18:50:54 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-29 18:50:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:55 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 6740 | hits on page: 40
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for FG97894: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for PX49171: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92609%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for SU92609: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG16297%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for CG16297: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for PF97491: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY05092%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for GY05092: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74932%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for NH74932: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86018%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for PC86018: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70645%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for EE70645: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV87257%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for GV87257: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW63947%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for DW63947: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR80797%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for MR80797: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG09776%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for JG09776: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN89851%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for KN89851: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN59057%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for SN59057: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30713%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for HN30713: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26034%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for HX26034: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM84539%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for JM84539: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA72016%27 HTTP/1.1" 200 None
2026-03-29 18:50:55 [auto1.de] INFO: Scrape type for SA72016: 0
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-29 18:50:55 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-29 18:50:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:56 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 6740 | hits on page: 20
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR46432%27 HTTP/1.1" 200 None
2026-03-29 18:50:56 [auto1.de] INFO: Scrape type for NR46432: 0
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-29 18:50:56 [auto1.de] INFO: Scrape type for GD21382: 0
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX76510%27 HTTP/1.1" 200 None
2026-03-29 18:50:56 [auto1.de] INFO: Scrape type for GX76510: 0
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT67052%27 HTTP/1.1" 200 None
2026-03-29 18:50:56 [auto1.de] INFO: Scrape type for DT67052: 0
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX36608%27 HTTP/1.1" 200 None
2026-03-29 18:50:56 [auto1.de] INFO: Scrape type for YX36608: 0
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-29 18:50:56 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-29 18:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR58634%27 HTTP/1.1" 200 None
2026-03-29 18:50:57 [auto1.de] INFO: Scrape type for HR58634: 0
2026-03-29 18:50:57 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-29 18:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM22131%27 HTTP/1.1" 200 None
2026-03-29 18:50:57 [auto1.de] INFO: Scrape type for LM22131: 0
2026-03-29 18:50:57 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-29 18:50:57 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-29 18:50:57 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-29 18:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 18:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-29 18:50:57 [auto1.de] INFO: Scrape type for UE63664: 0
2026-03-29 18:50:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 18:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 18:50:57 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 6740 | hits on page: 0
2026-03-29 18:50:57 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 18:50:57 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-29 18:50:57 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 44, <ScrapeType.BATCH_SKIPPED: 5>: 56}
2026-03-29 18:50:58 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1654 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-29T18_35_00.jl
2026-03-29 18:50:58 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 515077,
'downloader/request_count': 178,
'downloader/request_method_count/GET': 6,
'downloader/request_method_count/POST': 172,
'downloader/response_bytes': 29247482,
'downloader/response_count': 178,
'downloader/response_status_count/200': 178,
'dupefilter/filtered': 2,
'elapsed_time_seconds': 951.614942,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 29, 18, 50, 58, 107184, tzinfo=datetime.timezone.utc),
'item_scraped_count': 1654,
'log_count/DEBUG': 18853,
'log_count/INFO': 23700,
'memusage/max': 164458496,
'memusage/startup': 147980288,
'request_depth_max': 173,
'response_received_count': 178,
'scheduler/dequeued': 178,
'scheduler/dequeued/memory': 178,
'scheduler/enqueued': 178,
'scheduler/enqueued/memory': 178,
'scrape_type/batch_skipped': 3373,
'scrape_type/new': 2,
'scrape_type/price_update': 1652,
'scrape_type/skipped': 1751,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 178,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 4.005997022352276,
'scrapy-zyte-api/mean_response_seconds': 4.072169398083197,
'scrapy-zyte-api/processed': 178,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 178,
'scrapy-zyte-api/request_args/experimental.requestCookies': 177,
'scrapy-zyte-api/request_args/experimental.responseCookies': 178,
'scrapy-zyte-api/request_args/httpRequestBody': 172,
'scrapy-zyte-api/request_args/httpRequestMethod': 172,
'scrapy-zyte-api/request_args/httpResponseBody': 178,
'scrapy-zyte-api/request_args/httpResponseHeaders': 178,
'scrapy-zyte-api/request_args/sessionContext': 178,
'scrapy-zyte-api/request_args/url': 178,
'scrapy-zyte-api/status_codes/200': 178,
'scrapy-zyte-api/success': 178,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 6780,
'source/total_available': 6740,
'start_time': datetime.datetime(2026, 3, 29, 18, 35, 6, 492242, tzinfo=datetime.timezone.utc)}
2026-03-29 18:50:58 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 18:50:58 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ffb9713e090>
2026-03-29 18:50:58 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7ffb9713e450>